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DIVISION A: ADMINISTRATION 

PAPER SESSIONS 

COMMUNITY DECISION-MAKING AND EDUCATIONAL POLICY 

Community Status, Political Culture, and the Character of Suburban 
School Politics 

WILLIAM L. BOYD, University of Rochester; DAVID O'SHEA, 
University of California, Los Angeles 

Two comparative case studies conducted in the Chicago metro- 
politan area revealed marked and systematic differences in the character 
of school politics in blue collar and white collar suburban school 
districts. These differences appeared to flow from distinctly different 
political cultures in the two types of districts. Data in the two studies, 
which employed the deviant case analysis method and together 
included 23 districts, were collected by means of interviews and review 
of school board records. Some key variables affected by political 
culture were school board recruitment channels, conflict propensity in 
elections, and expectations held for and by citizens, board members, 
and superintendents. 

Cassadaga Valley: The Community Setting for Educational Innovation 

PAUL R. DOMMERMUTH, THOMAS A. PETRIE, RONALD E. HULL 
and DANIEL J. BAUMAN, State University of New York, Fredonia 

This paper reports on the differential response of four rural hamlets 
to the introduction of a system of individualized instruction in their 
school system. Using a variety of data gathering methods it describes 
the communities and their variations in demographic characteristics, 
along social and political power dimensions, and in terms of the crucial 
institutional networks which bear on the acceptance or rejection of 
these educational innovations. Using a variety of sociological rubrics a 
model is developed for examining the community context of educa- 
tional change. This model may be used to provide analytic depth to our 
understanding of social change. 

Parent Participation in Educational Decision-Making 

LOISS. STEINBERG, City College, City University of New York 

A four-year sociological field study of organized parent participa- 
tion in educational decision making in suburbia is reported. Data was 
obtained through participant observation and interviews with elite and 
non-elite participants and include: precipitating events, administrative 
procedures, formal and informal channels of communication and 
participation, parental socialization and influence strategies. The 
analysis, comparing school-controlled and independent activities, will 
focus on factors inhibiting and fostering independent action, the ad hoc 
group formation process and action outcomes. Findings are compared 
with previous research and theory on participation and discussed in 
terms of their significance to decision-making, community control of 
schools and social change. 

School Board Incumbent Defeat in Partisan Elections Related to 
Superintendent Involuntary Turnover 

FRANK W. LUTZ and PATRICK D. LYNCH, Pennsylvania State 
University; ALLEN W. MOEN # Superintendent, Brewster, Minnesota 

Objective of Study. School board incumbent defeat in non-partisan 
elections is related to involuntary superintendent turnover. (Walden, 
1966). That work, based on previous field work (Lutz, 1962) was 
developed into a political framework. (Lutz and lannaccone, 1969; 
Iannaccone and Lutz, 1970). This study investigated that framework in 
partisan school board elections. 



Procedures. 181 Pennsylvania districts where board members are 
elected as Republicans or Democrats were studied. Data were subjected 
to chi-square analysis. 

Hypotheses . Five hypotheses were tested to determine if partisan 
phenomenon changed this relationship. 

Resuits . Based on these data partisanism did not change this 
important political process in the politics of local school districts. 



CORRELATES OF TEACHER MILITANCY 
Perceived Need-Deficiency and Militancy 

LAWRENCE L. GIANDOMENICO and FRANK W. LUTZ, Pennsyl- 
vania State University 

This study investigated the relationship between Maslow's need 
hierarchy and militancy among public school teachers. Two hypotheses 
concerning this relationship were tested using data from a sample of 
247 teachers. The hypotheses were grounded upon the balance between 
that which the organization gives to the individual in the form of 
need-satisfaction and that which it demands from him in role 
performance. The results yielded a correlation between perceived 
need-deficiency and militancy of .3881. The use of multiple correlation 
indicated that higher order needs for self-actualization and autonomy 
were more highly related to militancy than needs from lower order 
categories. 

Teachers" Militancy, the Potential for it, and Perceptions of School 
Organizational Structure 

THOMAS G. GANS, Cleveland State University 

The relationships that exist among the militancy of teachers, their 
professed potential for such militancy, and their perceptions of their 
school organizations were studied in twelve San Francisco area high 
schools. Findings of this study include evidence that size and/or 
bureaucratization of schools are not directly related to militancy and 
do not adversely affect teachers' perceptions of the school organization. 
The sex of teachers also seems unrelated to their likelihood of being 
militant. Both potential militancy and perceptions of school structural 
openness were found to be directly related to militancy. 

Determinants of Attitudinal Militancy Among Professional Teachers 
and Nurses 

JOSEPH A. ALUTTO and JAMES A. BELASCO, State University of 
New York, Buffalo 

The basic concern of this paper is to identify those demographic, 
occupational and organizational variables which might differentiate 
between those professions that have higher levels of attitudinal 
militancy from those that exhibit less militancy. Semantic differential 
attitudinal data was collected from 414 teachers in two school districts 
and 482 nurses employed in three hospitals. Analysis indicated that 
attitudinal militancy is a generalized phenomenon across differing 
professions with organizationally based concerns, particularly frustrated 
career aspirations, as central differentiating factors. 

The Local Grievance Process in Education: An Empirical Case Study 

ALAN S. GLASSMAN, San Fernando Valley State College; JAMES A. 
BELASCO, State University of New York, Buffalo 

The principal concern of this study was to identify those personal, 
institutional and organizational variables which differentiated between 
frequent and infrequent use of the local grievance process. Analysis of 
variance and stepwise multiple regression indicated the centrality of 
organizational climate variables, and participation deprivation in par- 
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ticular, as possible contributors toward a higher use of the grievance 
process. Also suggested was the differential utilization of the initial 
grievance filing and appeal processes, with initial grievance filing being a 
traditional upwardly mobile middle class strategy, while grievance 
appeals may be designed to exert pressure for fundamental change on 
the system. 

Effects of Teacher Organizational Membership on School Expenditures 
and Policies in Illinois 

REX D. GIUNTOLI, Illinois State University 

This study measured the relationship between teacher organizations 
being represented at the bargaining table and monetary gains, internal 
budget ratios, and working condition policies. Three lists of districts 
were grouped as Illinois Federation of Teachers, Illinois Education 
Association, and Independent Districts. Information was obtained from 
both the school districts and the Office of the Superintendent of Public 
Instruction. The data was analyzed by using the chi square, the multiple 
linear regression and the analysis of variance. The Illinois Federation of 
Teachers made greater gains monetarily and in working condition 
policies than the other groups. The internal budgets were not affected. 



DEVELOPMENT AND EVALUATION OF UCEA URBAN SIMU- 
LATION MATERIALS 

Participant Evaluation of UCEA Urban Simulation Materials and 
Workshops. 

JOHN BLOUGH, The University Council for Educational Adminis- 
tration 

The paper will report the results of an evaluation by participants in 
ten summer workshops of UCEA Urban Simulation materials and 
methods. The results of a questionnaire will be summarized and issues 
derived from the data for future simulation work in educational 
administration. 

Effects of Instructional Intervention on the Behavior of Participants in 
Coping with Information Overload in Simulated Decision Making 
Situations. 

W. RAY CROSS and VERNON HENDRIX, University of Minnesota 

The paper will report on a study testing the effects of an 
instructional intervention upon the subsequent behavior of subjects in 
dealing with information overload in a simulated administrative 
environment. Subjects will be observed playing the role of a junior high 
school principal in one of the UCEA Urban Simulations. Comparisons 
will be drawn between pre- and post-test behavior on ten plus ten 
in-basket items. 

A Case Study of Simulation Use 

LLOYD DUVALL and GLENN IMMEGART, University of Rochester 

Simulation workshops have been conducted at The University of 
Rochester for a number of years. Over that period of time, different 
types of simulation materials have been used, a variety of workshop 
purposes have been pursued, and a number of instructional techniques 
have been employed. The experience thus gained has provided a 
background in simulation which may be of value to instructors, to 
researchers, and to developers of future simulations. The purposes of 
the paper, then, are threefold: (1) to describe one approach to 
simulation materials use, (2) to contrast the use of earlier simulation 
materials with the use of the URBSIM materials, and (3) to suggest 
future directions for research, instruction, and development of simu- 
lation materials. 



A Factor Analytic Study of Administrator Values and Behaviors in 
Simulated Decision Making Situations. 

ALAN K. GAYNOR, Boston University; L. JACKSON NEWELL, 
University Council for Educational Administration 

The paper will report the results of investigative work done on 
several structured feedback instruments developed for use in workshops 
employing UCEA Urban Simulation materials. The purpose of the 
study is to identify common factors of administrative behaviors and 
underlying value assumptions. Instruments include the following: (1) 
Value Resolution Scale, (2) Action Analysis Profile, (3) Means of 
Communication Profile, (4) Value Assumptions Profile. Correlates 
include the Rokeach D-Scale and items on a Personal Information 
Questionnaire. 



DIFFERING APPROACHES TO EVALUATING SCHOOLS 

Comparing Block Scheduling and Traditional Scheduling on Student 
Achievement and Attitudes 

ADRIAN P. VAN MONDFRANS, Brigham Young University; JAMES 
L. SCHOTT, Oakridge (Tennessee) Senior High School; DENNEY G. 
FRENCH, Richmond (Indiana) Senior High School 

This study compares the effects of block versus traditional 
scheduling on student achievement and attitudes for high school 
freshmen through seniors. The block scheduling allowed greater 
flexibility in course administration on time and group size variables. In 
general, this added flexibility did not result in better achievement or 
attitudes. Significant gains in achievement due to block scheduling were 
noted for seniors only. Three possible explanations for this finding 
include: (1) teachers presently cannot use flexibility in time and group 
size effectively, (2) these two variables are relatively unimportant, or 
(3) these two variables are important for mature Ss only. 

The Quality Assurance Model for Process Evaluation 

MAX LUFT, JANICE LUJAN and KATHERINE BEM IS, Southwestern 
Cooperative Educational Laboratory 

The Quality Assurance Model of Process Evaluation has been 
developed by the Southwestern Cooperative Educational Laboratory. It 
provides educational administrators several alternative techniques for 
maximizing desired terminal behaviors. By working with project 
directors, the evaluator helps to assist the program's implementation, 
providing prescriptive feedback in the program's weakest areas. Portions 
of the model have been used by over 50 educational administrators 
working with 500 teachers in a six state area in the Southwest. Several 
different programs have found it successful, and its adaptability makes 
it important to educational administrators and those preparing for roles 
that will require skill in project evaluation. 

Evaluating the Performance of Total Instructional Systems 

ERNEST A. VARGAS and LAWRENCE E. FRALEY, West Virginia 
University 

The performance of complex instructional systems can be evaluated 
by an index of instructional accomplishment (I a) which is a function 
of 1) change in learner behavior, 2) the consumption of learner time, 
and 3) the dollar cost of all system resources expended to provide the 
instruction. The three factors are expressed as consumed or attained 
percentages of the maximum attainable or allowable levels. (!a = 
AS 90 

T+C 80"+60 = reveals that on an interval of instruction costing 

60% of allowable resources, a learner who spent 80% of the maximum 
allowable time learned 90% of what remained unlearned beyond his 
pretest level. 




ECONOMICS AND EDUCATIONAL OUTPUT 



EDUCATIONAL ADMINISTRATION: DIFFERING PERSPECTIVES 



Implementing Cost-Benefit Research in Education 

RICHARD H. P. KRAFT, Florida State University 

Investment in education is as important to economic development 
as investments in physical capital. A cost-benefit analysis indicated that 
the rate of return for the middle school education in Korea is 
noticeably higher (20.0%) than that for the high school level (11.2%) 
and for college and university graduates (9.5%). There are important 
implications of these and other economic and manpower considerations 
for governmental and educational decision-makers in Korea. Based on 
economic criteria it is concluded that the expansion of middle schools 
should be given high priority. Social and humane arguments support 
this contention. 



The Concept of Equalization in School Finance: Three Normative 
Models and Their Measurement 

G. ALAN HICKROD, TSE-HAO TCHENG and RAMESH CHAUD- 
HARI, Illinois State University 

Three normative models termed, "maximum-permissible-variance", 
"anti-determinism", and "inverse allocation" are outlined. The basic 
assumptions of the models are highlighted and methods of measure- 
ment commonly used with each model are criticized. Special attention 
is given to the use of the Pearson product moment correlation to 
measure equalization. Limitations of this procedure are stressed. 
Computational methods for the Gini Index of Inequality are given and 
a mathematical derivation is provided. Use of the Gini Index and the 
Lorenz Curve is illustrated with recent data from the state of Illinois. 

Selected Economic Benefits from Illinois Junior College Programs 

GEORGE W. FORGEY, Illinois State University 

The primary objective of this study was to determine the benefits of 
Illinois junior college programs. Benefits were defined as: (1) earnings, 

(2) job satisfaction and (3) absence of unemployment. The secondary 
objective was to discover determinate earning variables. Data from 562 
graduates of five Illinois junior colleges, analyzed by various bivariate 
and multivariate techniques, revealed that: (1) occupational program 
graduates had significantly greater earnings than transfer program 
graduates the first year of post-college employment, (2) job satisfaction 
was significantly related to the pursuit of an occupational program, and 

(3) the best earning prediction variables were "hours employed per 
week while attending college" and "sex". 

Accountability and Teacher Satisfaction 

ROBERT L. HORTON and CLIFFORD BRYAN, Western Michigan 
University 

Teachers were tri-chotomized into high, medium, and low levels of 
accountability. While teacher satisfaction appeared constant, teachers 
felt greater accountability did create more work and pressures from 
administrators and parents. An examination of the patterns of 
dissatisfaction within the low accountability group suggested that 
in-service training and positive assistance of supervisors may be key 
variables in increasing teacher satisfaction with high accountability. A 
variable interaction analysis indicated that frequency of assistance by 
supervisors, low experience, and SES, contribute toward greater 
satisfaction. It was concluded that greater accountability (such as 
required in contract learning) can be attained without decreasing 
teacher satisfaction, perhaps actually increasing it. 



The Values and Value Systems of Educational Administrators 

JOHN P. SIKULA, University of Toledo; ANDREW F. S1KULA, 
University of Illinois, Chicago Circle 

This study of 62 educational administrators supplies empirical 
evidence that supports the contention that there are significantly 
different profiles associated with different occupational-career groups. 
Utilizing the Rokeach Value Survey— Form D, the authors surveyed and 
compared the value configurations of twelve distinct groups and found 4 
that the profile of educational administrators differed significantly 
from other occupational-career and managerial groups. Educational 
administrators revealed that their goals or end-states of existence 
(terminal values) were relatively very idealistic and abstract in nature 
while their methodology or means of achieving (instrumental values) 
the end-states were of much less relative concern. 

The Administration of Teaching Personnel: Implications for a Theory 
of Role Conflict Resolution 

FRANK A. STANCATO, Central Michigan University 

The objectives of this inquiry are: 1) to present an overview of the 
concept of role conflict, 2) to examine areas of role conflict between 
administrative and teaching personnel, and 3) to discuss a number of 
strategies to resolve these conflicts. The areas of conflict consist of: 1 ) 
the degree of expertness for educating students, 2) the authority 
structure and the teacher's professional status, and 3) the ambivalence 
toward the concept of leadership. Suggested means for conflict 
resolution are: 1) defining the role of the curriculum supervisor as a 
service function, 2) the concept of empathy in role taking, and 3) the 
adoption of norm leveling conferences. 

Need Satisfaction of Educational Administrators 

FRANK BROWN, City College, City University of New York 

Five types of psychological need classes, ordered from the most 
basic to the most least basic, were studied— security, social, esteem, 
autonomy, and self actualization. A questionnaire on need satisfaction 
was applied to a sample of public school administrators. Analysis 
revealed that there *3 no relation between administrators' need 
satisfaction and community type, line or staff type positions, type of 
principalship, age, sex, ethnic identification, or organizational size. 
However, it did reveal the existence of a statistically significant 
relationship between administrators' need satisfaction and their job 
level, minority student composition of a school, and their level of 
education. 

The Poverty of Educational Administration 

DANIEL J. BROWN, State University of New York, Buffalo 

An important reason why educational administrators appear ill- 
equipped to meet contemporary challenges is the poverty of present- 
day administrative knowledge. Two general modes of generating such a 
knowledge base are outlined and contrasted: the humanist (involving 
verbal theory and "soft" data) and the scientific (involving formalized 
theory and "hard" data). A categorization of articles in Educational 
Administration Quarterly and the Administrator's Notebook is carried 
out and reveals an imbalance toward the humanist tradition. Implica- 
tions of this imbalance for the advancement of knowledge and for the 
resultant service of university departments to the field are discussed. 
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EDUCATION RESOURCE ALLOCATION: LOCAL AND STATE 

An Investigation in Educational Resource Allocations in School 
Districts 

THOMAS L. HARROW and CHARLES D. DZIUBAN, Florida Tech- 
nological University 

Information was collected from sixty-seven school districts con- 
cerning twenty-seven variables which constituted the optimum size 
school district. The variables were analyzed using the principal 
component procedure to identify factors for consideration when 
allocating educational resources to school districts. The results showed 
that teacher commitment, transportation of students, financing of 
school districts and pupil population in educational programs were the 
four main areas for school district allocations of resources. 

A Study of the Relationships Among District Size, Expenditure Level, 
and Composite Achievement 

STANLEY A. RUMBAUGH, DAVID L. DONOVAN, ROBERT J. 
HUYSER, and DAN I EL E. SCHOOLEY, Michigan Department of 
Education 

Simple linear correlations, partial correlations, and moderator 
variable techniques were utilized to investigate the effects of school 
district size on school district level expenditure and composite 
achievement. Expenditure data were assembled on more than 500 
Michigan districts and the achievement data were collected on over 
300,000 pupils at the fourth and seventh grade levels. Overall 
correlations accounted for only two percent of the variance. Partial 
correlations yielded a slight increase in the coefficients. Using size as a 
moderator variable scale seems to be promising. The results will be 
discussed in terms of their impact for educational decision makers. 

The Estimation of a Long Run Cost Function for West Virginia Public 
High Schools 

GARY P. JOHNSON, Pennsylvania State University 

Public schools today face increasing financial pressure. The present 
paper sets out a model which generates new, relevant information about 
the relationship between educational output, scale and per-pupil costs: 
information which, if used, would result in more efficient educational 
spending. Specifically, a long run average cost function is estimated. 
Minimum per-pupil operating costs are achieved when average daily 
attendance is 1,426 students and the total square feet of facility is 
124,062. It is the first time such a model has been used in public 
education and has particular relevance for decisions pertaining to 
investment in new facilities and/or consolidation. 



ORGANIZATIONAL RESPONSE TO MINORITY GROUP CLIENTS 

Academic Performance and Prediction of Performance of Specially 
Admitted Economically Disadvantaged Students and Other Students in 
an Urban Restricted-Admissions High School 

MAUREEN C. MARAZZI, Brooklyn College, City University of New 
York 

Comparison over four years of academic performance (Reading, 
Algebra, and Weighted Grade Point Average) of two groups of students 
regularly admitted, via an Admissions Test, and one group specially 
admitted, via a Summer Program, to a Specialized High School in New 
York City, showed significant differences. Mean scores in Reading were 
significantly lower in the specially admitted group but mean scores in 
Algebra and Weighted Grade Point Averages were as high or higher in 
this group than in the regularly admitted group scorings in the lower 
quartile on the Admissions Test. Proportions of dropouts did not differ 
significantly. 



The Participation of Minority-Group Parents in School Activities: A 
Study and a Case Study with Guidelines 

JOE L. REMPSON, Bronx Community College, City University of New 
York 

The study identified factors that help to explain the participation 
and nonparticipation of minority-group parents in school activities. A 
parent education program conducted by a parent organization in 27 
public elementary schools in New York City was evaluated and a study 
made of school-parent activities in these schools. Data were secured 
from parents, PTA presidents, teachers, principals, and records. 
Questionnaires, interviews, informal contacts, and observations were 
used. Seven main hypotheses and nine "popular" hypotheses were 
tested, and a case study was made of the experimental program. The 
findings enabled the formulation of 24 guidelines for reaching 
minority-group parents. 

Exceptional Graduate Admissions at The Pennsylvania State University 

MANUEL G. GUNNE and LARRY L. LESLIE, Pennsylvania State 
University 

Although exceptional admissions critics assert that the quality of 
graduate programs will decrease as admissions criteria are changed, data 
to substantiate this claim have not been justifiably presented. Through 
the use of survey methodology, this study attempted to ascertain the 
possible difference between exceptionally admitted graduate students 
and traditionally admitted graduate students at The Pennsylvania State 
University. Findings indicated that exceptionally admitted students 
were perceived by knowledgeable faculty to be approximately equal in 
ability and achievement to traditionally admitted students. This was 
true for the university as a whole and for colleges and departments 
considered separately. The implications are clear. 



PERCEPTIONS OF SCHOOL LEADERSHIP AND CLIMATE 

A Study of Principal Leader Behavior and Contrasting Organizational 
Environments 

FRED C. FEITLER, Southern Tier Regional Education Center 

This study examined relationships between leader behaviors of 
elementary school principals and organizational processes of their 
schools. T-tests were used to determine significant relationships 
between leader behaviors, measured by the Leader Behavior Description 
Questionnaire— Form XII, and contrasting school typologies, described 
by the Profile of a School instrument. Twenty-three schools and four 
hundred twelve teachers comprised the sample. Four leader behaviors, 
tolerance of freedom, consideration, integration, and tolerance of 
uncertainty, were found to be significantly higher for schools having 
participative group organizational processes than for schools described 
as having more authoritative processes. Implications for organization 
development and research are discussed. 

The OCDQ Revisited 

ANDREW E. HAYES, University of Georgia 

The purposes of this study were (1) to determine the factor 
structure of the Organizational Climate Description Questionnaire when 
the original data were subjected to statistical procedures that have 
become available since the original Halpin and Croft climate study was 
conducted and (2) to identify "climate types" that are based upon the 
factor structure which was identified through these new analyses. 
Maximum likelihood factor analytic methods with subsequent oblique 
rotations of the factor matrices and taxonometric clustering procedures 
followed by multiple discriminant analyses yielded factor solutions and 
"climate types" that differ from those which Halpin and Croft 
identified in their original climate study. 
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Principal Leadership Styles and Effectiveness as Perceived by Teachers 

ROBERT T. UTZ, University of Toledo 

Urban teachers were asked to evaluate their Principals by: (1) 
ranking his overall effectiveness; (2) rating his consideration for 
teachers, development of learning programs, and plant management 
skills; (3) responding to a scale operationalizing the concepts of concern 
for "Production" and "People," adapted from Blake and Mouton's 
Managerial Grid l Results indicated a positive linear relationship between 
the Principal's perceived effectiveness and his scores on both "Produc- 
tion" and "People" dimensions. Parallel relationships were found 
between his perceived effectiveness and his ratings on consideration, 
learning programs, and plant management. Principals perceived below 
"Average" ranked lower on "People" skills than on "Production" skills. 

The Relationship of Students' Personality Structure, Socioeconomic 
Background, and Program Placement to Their Perception of the 
Organizational Characteristics of Select Public High Schools 

GEORGIANNA A. LYNN, Newark State College; LLOYD K. BISHOP, 
New York University 

Four hundred sixty-two students from thirteen public high schools 
in the New York City metropolitan area responded to the Stern 
Activities and High School Characteristics Indexes. Variables such as 
school setting, student SES and program placement were controlled. 
Factor analysis yielded a profile of youth and school divergent from 
earlier major adolescence studies. Significant differences among schools 
and students for both the A I and the HSCI are reported. Factor 
reliability is adequate. A joint factor analysis indicates clear instrument 
independence. Employing the Al and HSCI in concert, important 
information concerning student needs-patterns and organizational 
presses as perceived by students is presented. 



RESPONSES OF ORGANIZATIONAL PARTICIPATIONS TO 
INNOVATION 

Interpersonal Compatibilities of innovative and Non-lnnovative School 
Principals and Curriculum Coordinators 

WILLIAM K. WIENER, Lenoir-Rhyne College 

Is the relationship between the principal and the curriculum 
coordinator a variable that is related to the successful adoption of 
innovations in schools? A procedure for selection of innovative and 
non-innovative schools is making use of Miles' (1964) typology of 
innovation in education was tested. Principal-curriculum coordinator 
interpersonal compatibilities were ascertained from FIRO-B scores 
(Schutz, 1958) and comparisons on innovative/ non-innovative prin- 
cipal-curriculum coordinator compatibility were made on sixteen 
compatibility dimensions. Findings indicated significantly greater 
innovative principal-curriculum coordinator compatibility in areas 
where control and power were issues. This suggests some implications 
for the selection and subsequent prerogatives of innovative principals. 

A Conflict Model of Change: The Advocate 

ERNEST R. HOUSE, JOE M. STEELE and THOMAS KERINS, 
University of Illinois, Urbana-Champaign 

A study was conducted to investigate empirically the nature of 
program development, testing Roger's model of collective adoption of 
an innovation against the data, and distinguishing between the 
developmental patterns of high and low quality programs. The 
development of a new quality program was found to be dependent 
upon the interaction of a small number of powerful variables, best 
described by an "advocate" model of program development. These 



findings suggest a "conflict" model of educational change may be more 
accurate than the consensus models now employed. 

The Effect of Educational Consultant Teams on the Acceptance of 
Innovations 

JACK SANDERS, Ohio State University; GARY D. BORICH, Uni- 
versity of T exas 

This study reports the development and assessment of a model for 
engendering the acceptance of innovations with the use of educational 
consultant teams. A questionnaire was constructed and empirically 
validated to test (a) the number of innovations adopted, (b) the 
correspondence of innovations with an individualized learning model, 
and (c) the adoption of individualized instruction. Twelve schools were 
assessed, six with consulting teams and six without consulting teams. 
Results indicate the number of innovations adopted was greater for 
schools with educational consultant teams. Implications for the 
diffusion and adoption of innovations within the context of the 
elementary and secondary school are discussed. 



SCHOOL AS A BUREAUCRACY 

The Relationship Between the Formal and Informal Organizations of 
Three Kansas Secondary Schools 

EDWARD H. STEHNO, Fort Hays Kansas State College; MILO 
STUCKY and CECIL G. MISKEL, University of Kansas 

Purpose: The relationship between formal and informal secondary 
school organizations is described. Conceptual developments in organi- 
zational theory by Weber and informal organizational theory by 
lannacCone provided catalyst for the study. Sociometric Questionnaires 
and School Organizational Inventories were administered to 204 staff 
members in three secondary schools. Informal groups were determined 
by factor analysis. Multiple stepwise discriminant analysis was used to 
determine the discriminant functions of formal organizations and other 
demographic variables. The perceived formal organization had little 
effect upon informal interpersonal school relationships. Sex and 
curriculum area affiliation of staff members were the predominant 
factors for determining informal groups. 

School System Bureaucratization and Teachers' Sense of Power 

RUSSELL W. MEYERS, University of Colorado 

This study investigates the relationship of school system bureau- 
cratization and teachers' sense of power. Bureaucracy is considered a 
multidimensional concept. Data were gathered from thirty Illinois 
school systems. The system is the unit of analysis. Positive relationships 
were hypothesized between bureaucracy and sense of power. None of 
the seven specific hypotheses was supported in the data analysis. Two 
primary conclusions are suggested. (1) Bureaucracy may not be a useful 
concept in explaining sense of power. (2) Labor-management conflict in 
schools may be a more powerful explanatory concept in explaining the 
level of teachers' sense of power. 

Staff Conflict, Organizational Bureaucracy, and Individual Satisfaction 
in Selected Kansas School Districts 

EDWARD H. GERHARDT and CECIL G. MISKEL, University of 
Kansas 

Using conflict, organizational, and incentive theory as a basis, the 
study isolated specific factors in teacher conflict and related them to 
school bureaucracy, individual satisfaction, and central life interest. A 
stratified random sample of 642 public school teachers responded to a 
Likert-type questionnaire containing items measuring each of the 
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variables. Correlational analysis revealed positive relationships between 
conflicts and bureaucracy. Stepwise regression indicated that individual 
satisfaction is the best predictor of conflict, followed by the hierarcha! 
authority dimension of bureaucracy. Central life interest was a 
significant factor in individual satisfaction. Implications were used to 
support and modify conflict and incentive theory. 



TEACHERS, PUPILS AND PERCEPTIONS OF CONTROL 

Job Satisfaction of the Public School Teacher, a Function of 
Subculture Consensus with Respect to Pupil Control Ideology 

VINCENT D. YUSKIEWICZ, Northeastern Educational Intermediate 
Unit #19; WILLIAM S. DONALDSON, Pennsylvania State University 

Teachers' own attitudes to pupil control, teacher perceptions of 
their colleagues and/or principals' attitudes toward pupil control were 
investigated using coefficients of correlation, f-tests of selected vari- 
ables, and multivariate regression correlations to test hypothesized 
relationships. A total of 910 teachers— 473 elementary and 437 
secondary— were assessed. Teacher job satisfaction was found to be a 
function of subculture consensus with respect to pupil control 
ideology, accentuated in terms of teaching level and experience. Forty 
percent of the variability in job satisfaction was accounted for by using 
internal-reward-type independent variables, an R^ of 0.40 was gene- 
rated in the prediction of job satisfaction. 

Schools as Seen by Children: A Factor Analytic Study of the 
Perception of Fifth and Sixth Grade Children Toward Elementary 
School Environments 

DAVID G. SADKER and ROBERT SINCLAIR, University of Massa- 
chusetts 



The investigation's objective was to establish factorial validity and 
reliability of an industrial selection device based on Herzberg's theory 
of work motivation to the school organization. The questionnaire was 
reworded to reflect an educational work situation. A random sample of 
197 students, 118 administrators, and 432 teachers was made. 
Statistical procedures included varimax and maxplane factor analysis 
and Cronbach's item analysis. Six stable factors composed of 56 items 
with reliabilities ranging from .73-.83 were isolated. Finally, the 
theoretical basis and similar psychometric properties in different 
organizational types are indicative of versatility for probing many 
provocative relationships related to work motivation. 

Sources of Work Attachment Among Public School Teachers 

M. REX FULLER and CECIL G. MISKEL, University of Kansas 

The investigation examined sources of attachment to work as 
related to satisfaction, indifference, and dissatisfaction among public 
school teachers. The theoretical rationale for the study was constructed 
from the findings and conceptual assertions of Dubin's study of 
industrial workers. Furthermore, the questionnaire also paralleled the 
questionnaire for industrial workers developed by Dubin. When work 
features valued by a sample of 508 satisfied, indifferent, and dissatisfied 
educators were submitted to the chi square test, significant differences 
comparable to those reported by Dubin were found. In addition, the 
findings formed the basis for building a two tier incentive system for 
educators. 

The Effects of Various Attitude Congruence Conditions on Teacher 
Selection Decisions 

DANIEL L. MERRITT, Indiana State University; HARRY E. 
RANDLES and ROBERT CLEVELAND, Syracuse University 



This was a study to determine the nature of elementary schools by 
identifying the dimensions of the elementary school environment. In 
addition, the study determined similarities and differences in the 
various practices of elementary schools. A factor analysis of the 
perceptions of over 5,000 students in 54 elementary schools identified 
six dimensions of the elementary school environment: Alienation, 
Humanism, Resources, Autonomy, Morale and Opportunism. An 
instrument, the revised Elementary School Environment Survey, was 
created to provide educators with a tool to measure elementary schools 
along these six dimensions. 

Pluralistic Ignorance and Pupil Control Ideology 

JOHN S. PACKARD, University of Oregon; DONALD J. WILLOWER, 
Pennsylvania State University 

This research predicted and found inaccurate perceptions in a 
custodial direction of the pupil control ideology associated with various 
school- roles; a relationship called pluralistic ignorance. Pupil control 
ideology (PCI) is delineated on a custodial-humanistic continuum 
operationalized by form PCI. Self PCI scores of a random sample of 
Pennsylvania teachers, principals and counselors were contrasted via 
t-tests with PCI attributions for typical role occupants. Custodial 
pluralistic ignorance was observed in attributions of each group for the 
typical teacher and in teacher and counselor perceptions of principal 
ideology. Teachers were not inaccurate concerning counselor ideology; 
principals overattributed humanism to counselors. 

WORK VALUES AND TEACHER ATTACHMENT TO THE 
ORGANIZATION 

The Stability of a Modified Work Components Study Questionnaire in 
the Educational Organization 

CECIL G. MISKEL and LEONARD HELLER, University of Kansas 



The focus of this study was on the relationships between attitude 
congruence and selector's decisions about teacher candidates. Selectors 
rated a teacher applicant as part of a simulated teacher selection 
situation. The applicants were represented by written information in 
which the proportion of attitude congruence with the selector and 
relevance of the attitudes to the vacancy were varied. The data 
indicated that the selectors' decisions about teacher candidates are 
influenced by the proportion of congruent attitudes and are not 
influenced by the relevance of the attitudes to the position vacancy. 
The implications of the findings for teacher preparation programs and 
teacher recruitment are discussed. 

Collective Legitimacy 2nd Organizational Attachment: A Longitudinal 
Case Study of School Personnel Absences 

R. OLIVER GIBSON, State University of New York, Buffalo 

Absence is an important aspect of productivity. Hence it is 
important to understand better the dynamics of absence. It seems 
useful to conceptualize absence as contractual relationships within a 
social exchange framework. Within that framework collective legiti- 
macy and organizational attachment appear as promising explanatory 
concepts. The study is a longitudinal case investigation of patterns of 
absence behavior. Type and length of absence are seen as indicators of 
legitimacy and frequency of absence an indicator of attachment. The 
findings are consistent with the proposed sociological formulation and 
suggest that rules and regulations may confirm rather than initiate 
patterns of absence behavior. 



SYMPOSIA 

THE ADMINISTRATIVE BEHAVIOR OF COLLEGE DEANS 

FREDERICK R. CYPHERT, University of Virginia, ORGANIZER 
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The objectives of the Symposium are: 1) To bring together the 
major studies which give insight into the workings of the deanship; 2) 
To focus attention upon the need for additional research relative to this 
position of leadership; 3) To clarify the questions which give promise of 
greatest potential for future research and explication; and 4) To 
demonstrate the generic behavior of deans both across and within 
academic fields. 

The first presentation will be made by: Frederick R. Cyphert, Dean, 
School of Education, University of Virginia. His topic is "An Overview 
of the Research Literature Directly Relating to the Deanship". The 
scarcity of direct studies, the potential of related studies, and a strategy 
for promoting investigation and data-based performance will be 
discussed. 

Luvern Cunningham, Dean, College of Education, The Ohio State 
University will then discuss: "Preparing Administrators for Making 
Decisions". The deanship has been neglected as a field of training. The 
absence of tradition and the susceptability of the role to study make 
the possibility of research and research based preparation programs 
most exciting. 

Ralph W. Ingersoll, Assistant Dean, School of Medicine, University 
of Virginia will read his paper, "A Comparison of the Decision 
Strategies of Successful and Unsuccessful Deans". The similarities and 
differences of the major questions dean's feel are crucial are similar 
across academic areas and differ sharply between successful and 
unsuccessful deans. 

Arliss Roaden, Dean, Graduate School, The Ohio State University 
will discuss: "Dean's Decisions Related to Academic Governance". 
There is a general trend toward multirepresentational governance 
coalitions and the development of special interest unionization with 
conflict resolution taking place at the bargaining table. Much more of 
the dean's efforts will be devoted to this arena. 

Finally, Jay L. Chronister, Director, Center for Higher Education, 
University of Virginia will discuss the topic: 'The Application of 
Research in Decision Making to the Role of the Dean". The literature 
of the field could be strengthened considerably if decision theory and 
decision research were systematically related to major facets of the 
dean's rote. 

David L. Clark, Dean, School of Education, Indiana University, and 
Charles Donner, Assistant Dean, College of. Medicine, University of 
Washington, will discuss these papers. 

The educational importance of this symposium may be summarized 
thusly: the deanship is a significant leadership position in universities. 
Unfortunately, there is relatively little research based information 
relative to the effect of this role, and that which exists is not readily 
available. This symposium will pull together the major extant studies of 
the deanship, examine them critically, identify information of value to 
those persons who occupy the deanship, and delineate the nature and 
focus of needed research on the deanship. 



ANTHROPOLOGICAL STUDIES IN EDUCATIONAL ADMINISTRA- 
TION 

PAUL A. POHLAND, The University of New Mexico, ORGANIZER 

The purpose of the proposed symposium is threefold: (1) to 
illustrate the viability and vitality of anthropologically oriented 
methodologies to significant issues in educational research; (2) to 
further elucidate organizational decision-making processes; and (3) to 
shed further light on the dynamics of change within educational 
organizations. 

The research papers to be presented have as one common thread the 
issue of organizational decision-making as it is related to the change 
processes. A second commonality is methodological: all studies were 
conducted via variants on social anthropology. 

The first four papers move from a micro to a macroscopic 
consideration of the decision and change processes. Erickson's paper 



deals with organizational decision-making on the one-to-one level of 
student/counselor interaction. Reynolds considers organizational 
decision-making and the process of change using a particular school as 
the unit of analysis. Wheeland expands that unit to school district 
proportions, and Benenati makes the logical extension to the state 
politics of educational change. The final paper, Olson's, examines 
environmental and demographic considerations which may well influ- 
ence the decision and change processes whatever the analytic unit. 

Fredrick Erickson of Harvard University reports on the use of 
"cognitive anthropology" to delineate perceptions of organizational 
structure revealed in transcripts of school counseling sessions and 
transcripts of subsequent interviews with the participants in his paper 
"Scouting Organizational Mazeways: Decision Processes in the School 
Counseling Interview." 

Counselor and student bring to the interview differential percep- 
tions of the organizational structure of the school. These ideas are more 
or less tightly organized as "cognitive maps" which may or may not 
faithfully represent the organization as it actually exists. For the 
student "maximum utility" in the interview consists of learning about 
the organization and how to "deal" in it. He scouts the institutional 
territory under the tutelage of the counselor. 

Thus decision alternatives during the interview are closely related 
to: 

1. The actual organizational structure of the school, 

2. Structure as perceived by counselor and student, and 

3. Structure as symbolized in "catalogue" or list of courses. 

Larry Reynolds of the St. Louis Public Schools, in his paper 
"Problems of Implementing Organizational Change in the Elementary 
School: A Case Study" reports on the attempts by one school to 
implement innovative staffing and curricular changes. Staff reorgani- 
zation included a movement away from the self-contained classroom 
concept, re-structuring of the hierarchy of roles, increase in staff, 
changes in role (differentiation), and re-allocation of major decision- 
making responsibilities. Curricular changes centered on the institution 
of a program designed to improve the quality and quantity of arts 
instruction. 

The proposed changes were only partially implemented. Many of 
the characteristics of the previous instructional organization and 
curriculum were retained. Major impediments to the implementation of 
the proposed changes included the norm of teacher autonomy, the 
inability of the staff to reach consensus relative to the group 
decision-making process, and a lack of clarity with regard to instruc- 
tional change. 

A case study approach was employed utilizing participant observa- 
tion as the data collection medium. 

Jack WheeJand of Syracuse University will present the paper 
"Organizational Behavior in School District Consolidation". This paper 
describes via an anthropological approach how decisions were made 
relative to the reorganization of a parish-based parochial school system 
(Roman Catholic) to a county system having more centralized 
direction, coordination, and financing. The roles of the diocesan 
hierarchy, other clergy, religious, and lay people in the consolidation 
process are explored. Political, social, economic, religious, ethnic and 
educational variables are taken into account. The units involved include 
elementary. Junior High and High Schools. 

The study has national implications for parochial school systems. 
All face dwindling financial, staff, and student resources. With or 
without state and federal aid, most will have to change their 
organizational and financial structures as a prerequisite to survival. 

CarJ G. Benenati, New York State Education Department will 
discuss "State Politics in Educational Decision Making in New York 
State, K-12." This paper applies a two-stage "mandate model" (popular 
and policy) in analyzing the politics of educational decision-making in 
New York State. Both popular and policy mandates are conceived as 
functioning in an evolutionary and cycular manner. 

The popular mandate is conceptualized as the development of 
demands by individuals or groups upon the extant influence structure. 
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As such demands accelerate over time they reach "critical issue" 
proportions, thus setting the stage for the transformation of popular 
mandates into policy mandates. 

Policy mandates are conceptualized as significant changes in the 
preference, structural relationship, or processes which produce new 
policy directions within a political system and which have the force of 
law. 

Finally, John Olson, University of South Florida, will present 
"Human Ecology: A Means of Environmental and Demographic 
Analysis in Educational Research." This paper provides an ecological- 
demographic means of analysis for an elementary school attendance 
area by systematically organizing socio-cultural elements within the 
spatially delimited context of that area. Four fundamental concepts of 
human ecology— environment, population, technology and organi- 
zation— are employed. 

Data was gathered from both the private and public sectors of the 
community during the extended field study. Mapping the area to 
determine land use patterns, interviewing, and examination of records 
from school district and county planning offices were a few of the data 
collection procedures utilized. 

It is contended that this form of analysis (human ecology) provides 
a systematic means of analyzing current conditions and predicting 
future changes within a given educational environment. As such, it may 
be viewed as a possible and useful input into short and long range 
decision-making whatever the unit of analysis. 

Joseph McGivney, Syracuse University, will discuss the presenta- 
tions. 

The studies reported should contribute to the understanding of 
decision processes relative to change within educational organizations. 
The wide range of variables considered and the various anthropological 
approaches utilized should suggest directions for further research. 



CHANGE PROCESSES IN EDUCATION: SOME FUNCTIONAL AND 
STRUCTURAL IMPLICATIONS 

ROBERT J. COUGHLAN, Northwestern University, ORGANIZER 

We are in an era of headlong change, one in which the key 
institutions in our society are confronted with change and are 
themselves contributing to it. We at Northwestern University have 
found that many of the problems of change cut across institutional 
lines. The language may differ, the specific settings may vary, but there 
is an identifiable range of generic problems confronting all those who 
are managing organizations in times of great change. We believe that 
solutions found effective in managing change in one institution may 
offer guidance to the administrator in another. Further, those solutions 
implemented in one organization of society have consequences far 
beyond that segment. It is incumbent upon us then to maximize our 
findings by applying them across institutional lines where appropriate 
and where possible. 

The participants in the proposed symposium have been studying the 
change process in business, schools, government, and community 
organizations for several years. Using the concepts and techniques of 
the behavioral and social sciences, we have sought to identify those core 
structures and functions that are fundamental to the processes of 
change. From our studies and the findings of others in the field, we are 
also developing a joint Management-Education Program designed to 
train change agent teams for service in school systems. 

The purpose of the proposed symposium is to focus in on some of 
the functional and structural implications of change processes with 
special reference to education. Four specific objectives for the 
symposium have been developed: 1) to provide a summary and 
overview of the most recent and relevant research on change. Special 
emphasis will be pieced on the role and functions of change agents in 
relation to large scale social system change; 2! to suggest an 
inter-disciplinary framework which provides linkages between theory 



and practice in effecting durable change in ongoing educational 
systems; 3) to pinpoint the specific problems and needs of educational 
organizations in adapting to their complex and dynamic environments; 
and 4) to provide the rationale and support for a particular approach to 
social systems change which employs the change agent team concept. 

The five papers to be presented as part of this symposium are a 
product of collaboration among members of Northwestern University's 
School of Education and Graduate School of Management. The 
symposium participants, who are associated with the disciplines of 
educational administration, marketing, and organization behavior, 
examine the topic of educational change from a variety of perspectives. 

The firs., paper, "Change Agents and Social Systems Change," will 
be a critical review and synopsis of the major research and writings on 
the process of innovation in educational social systems. The paper, 
presented by Gerald Zaltman and Robert A. Cooke of Northwestern 
University, will place emphasis on the literature pertaining to the role 
of the change agent in the change process. Previous work will be cited 
concerning both micro-factors, such as the psycho-social attributes of 
change agents, and macro-factors relating to educational institutions as 
social systems and their conditions of successful or unsuccessful 
innovation. 

An initial Consideration in designing a program for educational 
change is the specification of the type of change agent to be utilized. 
This is the topic of the second paper, "Criteria for Type of Change 
Agent in Changing Educational Organization," by Robert B. Duncan 
and Robert A. Cooke, Northwestern University. This paper will focus 
on the kinds of choices and the trade-offs among the choices that the 
educational administrator will be faced with in specifying the change 
agent's role. A model will be outlined to guide the administrator in 
selecting the type of change agent to implement for effective change 
agent programs. 

The third paper deals with "Evaluative Research as a Component in 
Organizational Change Strategies." A great amount of human and 
financial resources are being committed to creating basic institutional 
change in educational systems. However, there is rarely a systematic 
evaluation component built into the program to assess the effectiveness 
of the change. In this paper, a basic overview of evaluation research will 
be presented in developing a change strategy that utilizes an evaluation 
component. This paper will be presented by Robert B. Duncan of 
Northwestern University. 

The fourth paper focuses on variables to be considered in 
implementing the change agent team approach to planned change. The 
presentation is titled "Implementing the Change Team Concept," and 
will be given by Robert J. Coughlan and Gerald Zaltman of North- 
western University. The first section of the paper deals with team 
considerations: Composition and size, recruitment and selection, etc. 
The next section outlines plans for developing the necessary under- 
standing, acceptance, and support of the approach by key decision 
makers within the system. The third section discusses structural, 
technological, individual and group barriers to and facilitators of the 
approach in schools. The final section presents various strategies and 
tactics for institutionalizing the approach in a school system. 

The final paper, prepared by Michael Radnor and Robert J. 
Coughlan of Northwestern University, provides "A Training and 
Development Program for Administrative Change in School Systems." 
The basic objective of the program is to develop, operate, and test a 
model designed to prepare teams of administrative change agents for 
service in selected school systems. Team members will receive training 
in both the technologies of administration and in the methodologies 
and skills of organizational change. Concurrently, the participating 
school system will be the subject of change preparation programs. 
Change agent teams and the target school systems will remain in close 
contact with the university, allowing for reinforcement of change 
efforts and program evaluation. 

The Chairman of the symposium, B. J. Chandler, Dean of North- 
western's School of Education, will initiate an open discussion of the 
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papers in an effort to uncover additional interpretations of the 
problem. Professor Everett M. Rogers of Michigan State University will 
be the principal discussant for this symposium. 



THE CHANGING EQUITY PRINCIPLE AND STATE EDUCATION 
FINANCE SYSTEMS: LEGAL, FISCAL AND POLITICAL DIMEN 
SIONS 

JOEL S. BERKE and ROBERT J. GOETTEL, Syracuse University, 
ORGANIZERS 

Attainment of equality of educational opportunity has long been 
one of the guiding tenets central to state systems of education finance. 
In 1905, Cubberly proposed that state aid schemes provide a minimum 
educational program through incentive grants citing the need to 
equalize the uneven burdens in school taxes. In 1923 Strayer and Haig 
noted that the need for "equalization of educational opportunity" 
continued to exist in proposing that state aid be allocated in inverse 
proportion to the wealth of local school districts. And in the 1930's 
Morrison argued that true equity in financing of education could not be 
achieved without shifting the responsibility for raising revenues and 
allocating ;*~o>urces completely to state governments. 

The last three to four years and particularly the latter half of 1970 
have witnessed perhaps a more intense focus on the equity principle in 
financing education than at any other time in the previous three 
quarters of a century. This newly aroused concern with equity results 
from our current crisis in school finance. Given the serious problems 
created by a lack of adequate funds for needed educational services, 
state finance systems are seen as contributing to a condition in which 
poorer school districts typically make greater efforts, but often produce 
only half the per pupil expenditures of more wealthy districts. Some of 
those districts which are less able fiscally have taken their case to the 
courts contending that state systems of educational finance have denied 
them the "equal protection" guaranteed by the 14th amendment to the 
federal constitution. The decision of the California Supreme Court in 
September, 1971, in Serrano vs. Priest may well serve as the most 
significant catalyst for generating fundamental revisions in state 
education finance systems throughout the nation. 

The purpose of this symposium is to examine three closely related 
dimensions to the current thrust for revising state systems of school 
finance: the legal, fiscal and political. What do the behaviors observed 
within each dimension portend for the restatement of the equity 
principle? How does each dimension relate to the ov'ier two? What do 
the fiscal and political realities suggest about the ability of reformers to 
achieve "equal protection" under the law? 

The participants in this symposium are consultants to, or staff of, 
the Policy Institute, Syracuse University Research Corporation. Their 
individual papers are products of recent research conducted for the 
New York State Commission on the Quality, Cost and Financing of 
Elementary and Secondary Education, the Senate Select Committee on 
Equal Educational Opportunity and the Lawyers Committee for Civil 
Rights. 

The first paper will be "The Implications and Applications of 
Recent 14th Amendment Challenges to School Finance Systems" by 
Joel S. Berke, of Syracuse University and Barrie L. Goldstein of George 
Washington University. On August 30, 1971, the Supreme Court of 
California struck down that State's system of educational finance as a 
violation of the 14th Amendment Equal Protection Clause. The 
infirmity, they held, was that California's pattern of shared State and 
local fiscal responsibility "invidiously discriminated against the poor 
(by making) the "quality of a child's education a function of the wealth 
of his parents and neighbors." 

In the wake of that decision, state educational finance systems 
across, the < nation have baen subjected to challenge. This paper will (1) 
examine and evaluate the newly emerging legal doctrine, (2) assess the 
prevalence of potentially unconstitutional inequities in educational 



opportunity, and (3) sketch, in broad outline, the range of legally 
permissible alternative finance systems. 

The second paper will be "Revising State Education Finance 
Systems: Simulating and Testing Policy Alternatives" by John Callahan 
of the University of Virginia and Robert J. Goettel of Syracuse 
University. 

When modifications in a state education aid formula are under 
consideration, the typical State Education Agency can computer 
simulate the potential impact of such modifications so that legislators 
can know (1) how much additional state aid will be required, and (2) 
the extent to which individual school districts will gain or lose. Until 
recently, the simulation techniques employed were usually capable of 
answering these questions due to the marginal character of proposed 
changes. But, the more sweeping revisions in school finance currently 
being suggested require more dynamic simulation and testing models if 
legislators are to fully understand policy alternatives. 

This paper examines several major state finance revisions and the 
procedures used to analyze their impact on school district per pupil 
expenditures, state aid and local tax rates in New York, Massachusetts 
and California. Policy alternatives include utilization of measures of 
educational need, municipal overburden factors in the general formula 
and regional and full state financing schemes. Attention is given to 
problems of data availability as well as analysis of options. 

Donna Shalala of Baruch College will read the paper "Revising State 
Education Finance Systems: A Case Study of Political Realities". 
Efforts to reform state systems of education finance have a long and 
vigorous history in the United States and have stimulated considerable 
scholarly interest. Most of this research has centered on curriculum 
reform and the structures of the governance of education. More 
recently political scientists and economists have concerned themselves 
with problems of education finance. However, little of this new analysis 
has focused on the political realities associated with revising state 
school finance systems. These political considerations include: (1) the 
changing characteristics of state legislatures resulting from the redistri- 
bution of population between city and suburb and the 1962 reappor- 
tionment decisions, (2) the inherent "no politics" ideology of educa- 
tion, (3) the special interests represented by state education 
departments, (4) the growing influence of teacher organizations and (5) 
the concerns of real estate interests as well as business and commercial 
pressure groups. The proposals of the New York Stcte Education 
Commission being considered by the 1972 Legislature represent 
comprehensive sweeping change in that State's existing education 
finance system. How traditional and emerging political forces affect the 
success and/or failure of those recommendations and the implications 
for revising state systems of school finance generally are the subjects of 
this analysis. 

Stephen Browning of the Lawyers Committee for Civil Rights and 
David Stern of Brookings Institute will discuss these papers. 



COMPONENT SKILLS OF INSTRUCTIONAL SUPERVISION: 
TRAINING AND EVALUATION SYSTEMS 

DELBERT K. CLEAR, University of Wisconsin, Milwaukee, 
ORGANIZER 

The objectives of the symposium are as follows: 1) to present and 
contrast two systems models of teacher supervision; 2) to compare 
existing instruments for the analysis of classroom instruction; 3) to 
present a model for the analysis of supervisory conferences; 4) to 
present and contrast two programs for the training of supervisors; 5) to 
present an initial evaluation of one program of instructional super- 
vision; and 6) to provide a forum for discussion of models, tools, 
training, and procedures for evaluation of instructional supervision 
programs. 

Instructional supervision is conceived as a continuous program of 
evaluation and training activities aimed at improving teachers' instruc- 
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tional behavior in order to increase pupil learning. School admin- 
istrators, particularly at the building level, and subject matter or grade 
level specialists, have usually been most responsible for supervision, 
though recently teachers themselves have begun to supervise other 
teachers, particularly in teaching teams. 

The participants in this symposium have been studying, analyzing, 
and practicing supervision in a systems framework. They have described 
several functions of effective supervision of in-service teachers and have 
explicated activities, skills, and instruments necessary to accomplish 
each. They also have developed training programs for preparation of 
instructional supervisors. 

The technical skills of teaching defined in micro-teaching research at 
Stanford University in the 1960's provide the basic foundation for the 
approaches to supervision that will be reported. Not only do the 
participants maintain, as did the Stanford researchers, that complex 
human tasks (i.e., teaching and supervision) can be parsed, but also they 
maintain that if supervisors and teachers concentrate upon the technical 
skills of teaching in a systematic structure, the purposes of instructional 
supervision can be met. 

Further, the participants have placed both the behavior of super- 
visors and training programs for them into systems models. These 
involve training supervisors to use a systems approach in their 
supervision, and to use various tools of supervision, such as educational 
and social psychological principles, group processes, classroom observa- 
tion instruments and the supervisor-teacher conference. 

Technical skills of supervision have been developed, along with 
specific protocols, to train supervisors to use the technical skills of 
teaching in teacher observation and conferencing. Field tests of the 
latter will be reported. It will be shown that the component-ski! !s-of- 
teaching approach provides teachers and supervisors with a useful 
foundation for supervision. 

The symposium will be presented with the following areas of 
concentration: 1) abstracting technical skills of supervision and the 
development of a systems model for organizing supervisors will be 
discussed by Delbert K. Clear, of the University of Wisconsin, 
Milwaukee, in his paper "Functions and Skills of Instructional 
Supervision"; 2) examining extant analysis of teaching instruments and 
procedures to determine which are most useful to supervisors will be 
discussed by Grace Lund, of the University of Wisconsin, Milwaukee, in 
the paper "Evaluation of Classroom Observation Instruments"; 3) 
analyzing supervisory conferences, developing a list of potentially 
useful conference foci, and constructing a taxonomy of conference 
strategies will be discussed by I.T. Johnson of the University of 
Wisconsin, Milwaukee, in his paper "Analyzing Supervision Confer- 
ences"; 4) training supervisors to use a systems approach will be 
discussed by David B. Young of the University of Maryland in the paper 
"Training Instructional Supervisors"; 5) applying the elements of the 
systems approaches and component skills of teaching and supervision in 
an elementary school is the topic of George R. Blommel, of 
Menomonee Falls, Wisconsin, Public Schools in his paper "Initial 
Evaluation of a Systems Approach to Supervision". 

The intent is to keep formal presentations to a minimum, with each 
participant taking not more than ten minutes to present an overview of 
his work. The discussants, Robert H. Pinney, of the University of 
Washington and G. Bradley Seager, Jr., of the University of Pittsburgh, 
will be asked to address their remarks and questions to the panelists 
rather than make separate, and perhaps unrelated, addresses. A 
substantial block of time will be reserved for the participants to interact 
with each other and the discussants to establish tight connections 
between their respective work. Lastly, audience interaction with the 
panel will be encouraged. The symposium chairman will make every 
effort to draw responses from the audience so that the panelists might 
be prompted to refine their work and ideas in light of the experiences 
and work of a large number of fellow researchers and practitioners. 



CURRENT RESEARCH RELATED TO THE YEAR-ROUND 
SCHOOL 

ROBERT E. SUTTON, Lemon Grove School District, California, 
ORGANIZER 

The Year-Round school plan is being implemented in various forms 
throughout the United States. The most popular and feasible plan 
appears to be the 45-15 plan whereby pupils attend school 45 days and 
are off 15 days completing a school year with 180 days of actual 
attendance. The objectives of the symposium will be to present 
information and research relative to: 1) the need for year-round 
schools; 2) the educational advantages and disadvantages of the 
year-round school; 3) the educational achievement of pupils under the 
year-round plan; 4) attitudinal changes in pupils, parents, and teachers 
as a result of the year-round plan; 5) economic factors involved in the 
year-round plan; and 6) problems of initiating the year-round school 
plan. 

Albert W. Lantz of La Mesa^Spring Valley School District will 
present information from that district regarding the implementation in 
that district in his paper "Year-Round School in La-Mesa-Spring Valley 
District". 

Two of the district's seventeen elementary schools and one junior 
high school began the year-round program in July of 1971. Information 
will include current student achievement test data, parent reaction, and 
staff concerns and problems. 

Leslie Six of Chula Vista School District has prepared the research 
design for determining student achievement and attitude changes 
resulting from the implementation of the 45-15 year-round education 
plan begun in July, 1971, in four of the district's twenty elementary 
schools. Dr. Six will present statistical data regarding test comparisons 
on student achievement, student and staff attitude changes, and parent 
acceptance of the program in the paper "Achievement and Attitude 
Changes". 

In the paper "Operating Costs and Staffing Patterns" by William 
Rogge of Valley View Public Schools, how that district originated the 
45-15 year-round plan and is now in the second year of operation, will 
be discussed. Mr. Rogge will present statistical results of a longitudinal 
study of student achievement under the year-round plan. He will also 
provide information relative to operating costs and staffing patterns 
resulting from two years of program operation. 

Mr. Rogge will review the intricate planning that preceded the entry 
of the Valley View District into a year-round plan. In addition, the 
construction and administration of community surveys and staff 
surveys will be discussed. 

Paul Radenheimer, of the University of Arizona, is currently 
reviewing literature and research relating to year-round schools. He has 
also acted as a research consultant to the La Mesa-Spring Valley School 
District which recently adopted the year-round school plan. Mr. 
Radenheimer will present a review of the literature which will trace the 
development of year-round schooling attempts from the early 1920's 
down to the present day. His paper is titled "Literature and Research 
Relating to Year-Round Schools". 

The importance of this symposium may be shown by noting that 
the possibility that this organizational pattern may well revolutionize 
the future calendar of school operation. The plan is a viable alternative 
for taxpayers who refuse to pass bond issues while expensive school 
buildings stand idle. 

The plan also provides parents with a variety of vacation and rest 
periods during the year. The traditional crowding of vacations into the 
three summer months has created over-use of all types of recreational 
facilities from city parks to wilderness areas. 

Research data related to the educational advantages of the year- 
round program as implemented in three major suburban school districts 
from July to April, 1972, for approximately 50,000 students will be 
presented for examination and discussion. The symposium will also 
shed light on the effects of the 45-15 year-round school plan on the 
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2,000 classroom teachers conducting the program. The work options 
provided by this plan are extensive and need the kind of educational 
exposure that the AERA Conference provides. 

Symposium participants will bring sample materials from districts 
presently involved in the 45-15 year-round program for distribution at 
the conference. 

ETHNIC MINORITY PERSPECTIVES ON THE EVALUATION OF 
EARLY CHILDHOOD EDUCATION PROGRAMS 

W. RAY RHINE, University of Missouri, St. Louis, ORGANIZER 

The purpose of the symposium is to present ethnic minority 
perspectives and recommendations on the evaluation of early childhood 
education. The ethnic minorities are demanding that their "experi- 
ence," values, and goals be represented in the social institutions that 
influence the lives of their children. They contend that the schools 
should support cultural pluralism in American society rather than 
attempting to indoctrinate all pupils with the values of the dominant 
Anglo middle-class culture. 

Ethnic minority spokesmen are insisting on a re-examination of the 
value assumptions that underlie educational practice and evaluation. To 
obtain favorable scores on many existing instruments, ethnic minority 
pupils must evidence Anglo middle-class values and behaviors at the 
expense of denying the values of their own ethnic group. They want 
instruments that reflect the ethnic values. 

Another suggestion is that measurement constructs should be more 
consistent with the social reality experienced by ethnic minority pupils. 
For example, the internal locus of control orientation (i.e., persona! 
acceptance of responsibility for success and failure experiences) is 
assumed to reflect the belief that a person possesses power over the 
consequences of his behavior. However, for a minority youngster 
growing up in the poverty of the ghetto, an internal control orientation 
may be an inaccurate, maladaptive, and excessively intrapunitive 
distortion and denial of the true conditions of his environment. Indeed, 
an external control orientation attributing the responsibility for success 
and failure to other people and forces may be a much more accurate 
perception of the environmental forces that really do act to shape and 
control the outcomes of his behavior.. 

Many of the issues to be discussed have been vigorously debated and 
clarified in Project Follow Through evaluation policy and planning 
sessions attended by Drs. Barnes, Ramirez, and Rhine. For the past 
three years, Rhine was a member of the Stanford Research Institute 
staff that has planned and implemented the national evaluation of the 
Follow Through. Barnes and Ramirez have been frequent consultants to 
the project. Follow Through is a comprehensive experimental education 
program to maintain and enhance the benefits of Head Start for 
disadvantaged children in grades K, 1, 2, and 3. Approximately 
two-thirds of the Follow Through population of 70,000 pupils are from 
ethnic minority groups. 

Drs. Barnes and Ramirez, the Major Presenters, have served as 
ethnic minority consultants for Head Start and Follow Through. In 
addition, each is chairman of a Social Science Research Council 
subcommittee on innovative approaches to measurement for ethnic 
minority children. 

Edward J. Barnes, Associate Dean of the College of Liberal Arts and 
Sciences and Director of the University Community Educational 
Program, University of Pittsburgh, will present the paper "Evaluation 
Research and the Education of Oppressed Minority Group Members." 

The evaluation of education programs, especially childhood educa- 
tion, cannot be limited to measures of classroom achievement. The 
focus must be enlarged to include the whole person-in-a-social-context 
whose academic and personal growth is affected by the quality of his 
environment. A child's self-concept is a significant aspect of his growth 
and cannot be separated from his performance in the classroom. 

Evaluation research that seeks to assist in understanding and 
resolving social problems must become more explicit about the 



underlying assumptions, values, and goals of those who construct the 
instruments. There are multiple subcultural groups varying in world 
view, styles, modes, values, etc. Education and evaluation research must 
be appropriate for each respective group. 

The exclusion of ethnic minority values from the society and from 
the schools is a primary reason for the failure of the schools to educate 
ethnic minority children. Evaluation research can assist the schools in 
serving all peoples of the society instead of representing and guarding 
the "White Anglo-Saxon ideal." 

Manuel Ramirez, Associate Professor of Mexican-American Studies 
and Psychology and Director, Bicultural Bilingual Project, University of 
California, Riverside, will discuss 'The Implications of Cognitive Styles 
and Cultural Democracy for Evaluation Research." 

Cultures and values of minority groups in the United States, 
especially those of Blacks, Indians, and the peoples of La Raza, have 
been viewed as pathological and inferior. Consequently, the education 
evaluation models applied to ethnic minority children have been based 
on inappropriate assumptions that are damaging. The result of ignoring 
culturally unique learning and incentive motivational styles is the 
alienation of minority group children from the schools. 

The new philosophy of cultural democracy insists that institutions 
must change to be consonant with the learning and incentive- 
motivational styles of ethnic minority children. In a compatible 
learning environment people will not be required to reject their identity 
to be considered successful and well adjusted. 

Wit kin's concept of field dependence-independence seems promising 
for implementing cultural democracy in evaluation research- Our 
preliminary research indicates that most Chicano children, especially 
those from traditional environments, are field dependent when com- 
pared to Anglo children of the same age, sex, and socio-economic class. 
The results of current research on acculturation and cognitive styles in 
three Chicano communities in California should help to develop more 
effective instructional programs for both field dependent and field 
independent children. 

Stanley Crockett of the Western Behavioral Science Institute will 
discuss these papers. 

National early childhood education intervention programs have 
become vehicles for the expression of ethnic minority values and 
demands for social justice. The controversy over the evaluation of 
programs such as Head Start and Follow Through reflects the deeper 
struggle among stakeholder groups for control of funding and decision- 
making on program operations. 

This symposium is presented in the hope that articulation and 
discussion of ethnic minority concerns and recommendations may assist 
in moving beyond confrontation to more productive discussion and 
resolution of these heated and divisive issues in American education. 

INCREASING THE EFFECTIVE USE OF ANALYSIS IN SCHOOL 
DISTRICT PLANNING 

SUE A. HAGGART, The Rand Corporation, ORGANIZER 

The objectives of this symposium are to investigate the nature of the 
resistance to the use of analytical techniques in school district planning 
and to suggest steps that may be taken to increase the effective use of 
analysis. The participants agree that modern analytic and management 
techniques do offer one way in which educational planners and 
administrators may begin to respond more effectively to some of the 
challenges facing education; they differ, however, in their approach to 
developing and using these techniques. 

It is the purpose of this symposium to delineate these different 
approaches for increasing the use of analysts and to encourage active 
audience reaction. The four fifteen-minute presentations are to be 
followed by two ten-minute discussions. The discussants are: Donald M. 
Levine of the Ontario Institute for Studies in Education, Toronto and 
James S. Dyer of the School of Management, University of California at 
Los Angeles. 



"Organization by Program as a Way to increase the Use of Analysis 
in School District Planning/' will be presented by Sue A. Haggart, The 
Rand Corporation. Current district organization does not provide the 
environment necessary for the development and use of analytical 
techniques in educational planning. This environment may, in part, be 
characterized by an adequate supply of timely data, appropriately 
analyzed, and a clearly discernible flow of decisions. The organization 
should facilitate both the collection of the data and the communication 
of the results of the analysis. 

More serious, however, is the likelihood that the current organiza- 
tion acts as a barrier to the acceptance of the results of analysis. This 
paper defines 'program', develops a program-oriented organizational 
structure, and compares this structure with the current organizational 
structure. The purpose is to demonstrate how organization by program 
enhances the environment for analysis and promotes the acceptance of 
analysis as well as the results of analysis. 

"Educational Planning with Organizational Development (OD): A 
People Involving Approach to Systemic Planning/' is presented by 
Donald M. Levine of Ontario Institute for Studies in Education, and C. 
Brooklyn Derr of Graduate School of Education Harvard University. 

Recently, administrators in educational systems have attempted 
versions of program budgeting, management information systems, 
operational planning, and even program and policy analysis. Yet the 
application of strategies for achieving more rational planning and 
management often have shown little substantive progress. A central 
reason has been the inability to make planning and management 
approaches understandable and meaningful to personnel throughout the 
school district organization. This paper explores an organic theory of 
planning which incorporates organizational development (OD) tech- 
niques for making analysis and planning activities more people-sensitive. 
A step-by-step plan for utilizing both formal planning methods and 
organizational development (OD) in a school district is described. 

"Heuristics: A Step Toward Getting There" is the topic of G. Ernest 
Anderson, Jr., School of Education, University of Massachusetts. 

Mathematical programming techniques allow us to find optimal 
solutions to a number of well-specified problems. These techniques are 
not yet widely used in education for many reasons, ranging from simple 
lack of knowledge to political unacceptability of mathematically 
"optimal" solutions. 

In the spirit of Operations Research, abetted by the computer, it has 
been possible to set up situations in which school administrators can try 
out plans they are considering, examine probable consequences, and 
modify plans accordingly, all at high speed, low cost, and without 
disturbing present school operations. The best known example of this is 
the "simulation" run in school scheduling, other examples include 
establishing school district boundaries, bus routing, facility planning, 
and staff utilization. These heuristic techniques, while mathematically 
primitive, are effectively useful today, and are a step toward the 
eventual use of more sophisticated techniques. 

"Evaluation of On-Going Programs to Improve School District 
Planning," will be presented by Marjorie L. Rapp, The Rand Corpora- 
tion. 

School districts have traditionally engaged in two kinds of evaluative 
activities. The first is an assessment, generally annual, of the current 
status of student achievement. The second more properly falls under 
the rubric of research. It can be defined as special studies individually 
designed to determine the effectiveness of some program. 

In today's more sophisticated educational environment these activi- 
ties do not give the decision maker the necessary information for 
program planning. 

This paper presents a model for continuous, systematic evaluation 
of on-going programs, and specifies data needed for decision making in 
the areas of program adoption, curtailment or expansion. 

The message of this symposium can be distilled into one thought. If 
more effective use c analysis in school district planning is to be 
realized, there must a meeting of the minds between the practi- 



tioners and the users. Achieving this end will require open discussion 
aimed at identifying the problems and seeking their resolution. 

THE NATIONAL EDUCATIONAL FINANCE PROJECT-A SUM- 
MARY REPORT 

GERALD R. BOARDMAN, University of Florida, ORGANIZER 

The National Educational Finance Project (NEFP) has been a major 
research effort involving a comprehensive study and a thorough analysis 
and critique of all state systems of school finance. The NEFP has been a 
cooperative endeavor involving state departments of education from 
each of the states, the USOE, and cooperating universities and local 
school districts. Funds came principally from Title V, Section 505, of 
the Elementary and Secondary Education Act; the project has been 
administered through the Florida Department of Education. 

Specifically, the purposes of the project have been to: (1) identify 
the dimensions of educational need in the nation; (2) identify target 
populations with special educational needs; (3) relate the variations in 
educational needs and costs to the ability of school districts, states, and 
the federal government to support education; (4) analyze economic 
factors affecting the financing of education; (5) evaluate existing plans 
of school financing; and (6) construct alternative school finance models 
and analyze the consequences of each. 

The primary focus of this symposium will be on the following 
research products of the study: 1) Status and Impact of Educational 
Finance Programs; 2) Educational Programs and Services— Needs and 
Costs; 3) Fiscal Capacity and Educational Resources; and 4) Alternative 
School Finance Models— A Computer Simulation. 

The presentations will focus on both the process and product of the 
NEFP research efforts in the four areas listed above. 

"Status and Impact of Educational Finance Programs" is the topic 
of Kern Alexander, University of Florida. All state school finance 
programs, including small categorical grants, in each of the 50 states 
have been classified and measured as to the extent of their equalization. 
Profiles have been developed to illustrate the impact of local, state, and 
federal revenues in school districts with varying levels of fiscal ability. 
An additional facet includes a comparison of the revenues available to a 
selected group of urban, suburban, independent cities, and rural areas. 
Consideration was also given to the equalization potential of non- 
property taxes as a potential major revenue source for financing local 
schools. 

The federal aid studies centered on the extent of the equalization 
effect of federal programs both among and within states. One sub-study 
compared allocations of ten major federal aid programs to the personal 
income of states as a measure of equalization. Other studies measured 
equalization of federal programs in terms of both pupil achievement 
test scores and personal income. 

"Educational Programs and Services— Needs and Costs" will be 
presented by K. Forbis Jordan, University of Florida. In this facet of 
the study a selected number of educational programs were identified. 
The sample school districts were chosen on the criterion of reputational 
best practice, which indicates that they cannot be construed as 
representative. Future programs for various levels of educational 
programs were projected. Cost analyses were conducted of existing 
programs. Present and potential target populations were identified. 
Projections were made on the basis of these cost and population data 
except in those instances where the research process did not yield 
reliable data for projection purposes. 

Programs included pre-school through community college and adult 
education. Services consisted of transportation, food services, and 
capital outlay. 

"Fiscal Capacity and Educational Resources" will be discussed by 
Richard Rossmiller, University of Wisconsin. The primary objective of 
this phase of the NEFP research was to identify differences in relative 
fiscal capacity of school districts serving areas of varying economic and 



demographic characteristics and to assess fiscal capacity in terms of 
expenditures for public service by all units of local government. 

Additionally, consideration has been given to the present effort 
being made by various states and their fiscal potential in terms of 
existing and potential usage of various revenue sources at the state level. 

"Alternative School Finance Models— A Computer Simulation". 
Among the products of the National Educational Finance Project is a 
modeling or decision-making process which may be used by real-life 
policy makers or in the instructional mode for classroom situations. 

The process encompasses a data bank with a full range of 
information dealing with pupils by program, fiscal resources and related 
evaluative data for a prototype state; decision-making opportunities; 
and output reflecting the impact of these decisions on the state and its 
local districts. The long term benefit of the process is reflected in its 
potential of being implemented in an actual state when basic data have 
been gathered. 

The underlying assumption is not that there is one best program, 
but that various alternatives are available. The best choice will be 
dependent upon the desired level of taxpayer equity and access to fiscal 
resources. 



OPERATIONS RESEARCH-SYSTEMS ANALYSIS IN EDUCA- 
TIONAL PLANNING 

JAMES E. BRUNO, University of California, Los Angeles, 
ORGANIZER 

The use of techniques and methodologies of systems analysis- 
operations research is being accorded increasing emphasis by school 
administrators responsible for school district management and planning. 
Several graduate schools of education already have or are contemplating 
developing curricula in these areas for the preparation of school 
administrators. The purpose of this symposium is to report some of the 
more recent and important applications of operations research to 
problems in school district planning. The papers themselves will cover 
various facets of school district management and will include quantita- 
tive applications to instructional evaluation, conflict resolution class 
scheduling in education. The following is a description of each 
presentation. 

"A Mathematical Programming Approach for Matching Faculty to 
Courses" will be presented by Gary M. Andrew, University of Colorado. 
The problem of matching available faculty to courses, research and 
administrative assignments which must be filled is constantly being 
faced by deans, department heads, and faculty committees. This paper 
defines the goals and constraints involved in assigning faculty to 
courses. A procedure for setting preference and effectiveness ratings is 
described. 

Once the problem is formulated, the Ford-Fulkerson dual transpor- 
tation algorithm, based on mathematical programming procedures, is 
used to obtain particular assignment solutions. A recent application of 
the model to assign 40 faculty members in an electrical engineering 
department is used to illustrate the generalizabilrty of this approach. 

"Analysis of Constituency Demands for Curricular Electives in 
Public School Systems" is the topic of James F. McNamara, University 
of Oregon. The purpose of this paper is to illustrate a mathematical 
model that can be used by school districts to evaluate alternative 
decisions about curricular electives in public school systems. 

The model utilizes linear programming techniques to construct 
constituency preference functions and to determine optimal curriculum 
electives for each constituency. Alternative curricular decisions are then 
evaluated using a conflict matrix based on teacher availability, 
curricular electives, budget considerations and instructional resources. 

A recent application of the model in Oregon is used to demonstrate 
the generalizability of this approach for public school systems. 

"Reorganization of Large Urban Districts" will be discussed by 
Daniel B. Davis, Washington Internship Program. This exploratory 



planning study develops and applies two mathematical programming 
models, an interactive model and a heuristic model, for the reorganiza- 
tion of large urban school districts. The models maximize an objective 
function subject to political, social, and economic constraints, utilizing 
census tract data as the basic unit of analysis. 

The objective function maximized by these decision-oriented 
approaches is that of heterogeneity of racial composition, although 
these two models are general enough to be applied to any kind of 
redistricting problem with different objectives and/or constraints. The 
heuristic model is similar to the linear programming approach used to 
re-draw congressional district boundaries. Results from actual applica- 
tion of the model for the Los Angeles City School District are reported. 

"Incorporation of Utility into School District Performance Con- 
tracts" will be presented by James E. Bruno, University of California, 
Los Angeles. There is a current need in education, due in part to recent 
emphasis on accountability and performance contracting, for a method 
of evaluating achievement gains for the purpose of compensation of 
contractors. The term contract used in its broadest sense, could include 
a state-school district contract, or a school district-teacher contract or 
what is presently receiving increased attention— a school district-private 
corporation contract. The interval shift analysis which maximizes Net 
School District Utility is a simple procedure based upon linear 
programming techniques which permit school districts or the contractee 
to establish a goal in standardized intervals and define some utility for 
the interstandardized intervals transitions. The model then calculates 
the maximum Net School District utility for two transitions— from the 
initial to the achieved distribution and from the initial to the goal 
distribution. The ratio of the Maximum Utilities Net, initial to achieved 
and initial to goal is a quantitative continuous measure and assessment 
of the degree to which the goal has been met and can be directly used 
in the compensation of the contractor. 

"Decision Parameters and Attitudes of Public Administrators and 
Planners" will be presented by Bob L. Wynia, University of Oregon. 
The purpose of this study was to determine decision parameters and 
attitude of public administrators and planners who now hold civil 
service positions (above G.S. 14) in federal government agencies and 
who are responsible for the administration and planning of educational, 
public welfare, defense and other government programs. 

These results were then compared with national samples of political 
influential and the general electorate to determine differences in (1) 
economic equality, (2) social and ethnic quality, (3) democratic values, 
(4) cynicism toward government and (5) sense of political futility 
between these bureaucrats and the constituencies they serve. 

ORGANIZATION DEVELOPMENT: A DESIGN FOR CHANGE 

SAMUEL G. CHRISTIE, Institute for Development of Educational 
Activities, Los Angeles, ORGANIZER 

The overall goal of organization development is to integrate personal 
needs with organizational goals. As with any human enterprise, there 
are differences of opinion on how to achieve this integration. Some 
approach the problem from the individual perspective, seeking ways to 
help individuals achieve greater personal satisfaction in the organiza- 
tional setting. The assumption is made that meaningful achievement of 
organizational goals cannot be made until the personal needs are 
satisfied. 

Others approach the problem from the organizational perspective, 
giving more emphasis to the achievement of organizational goals 
through the adoption of systematic procedures and broadening the 
participation of members in decisions that affect them. The assumption 
is made here that participation in decisions on issues that concern them 
will satisfy needs of individuals sufficiently to achieve the goals of the 
organization. 

The purpose of this symposium will be to inform both participants 
and observers of the results of various efforts to promote change in 
schools from an organization development framework; to develop 




13 




further understanding of the purposes, differing strategies, successes, 
failures, advantages and limitations of OD in an educational setting. 

To achieve these objectives the symposium will promote an 
interchange between individuals working from this problem solving 
perspective, but who are performing in different roles, that of 
consultant-change agent, developer, and user, and giving different 
emphases to their work. 

The basic issues around which these differences revolve are those of 
conflict versus consensus, systems planning versus humanism, and ends 
versus means. The questions generated by these differences include the 
following: 1) Is conflict counter productive, something to be resolved 
or something to be encouraged, to be used as a vehicle for change? 2) Is 
it productive for change agents to concentrate primarily on developing 
rational procedures, on systems planning, or primarily on the human- 
istic element in organizations, on developing interpersonal relation- 
ships? and 3) How can the OD effort be expanded so that a significant 
portion of the 20,000 school districts in the United States be reached? 
Can OD be packaged? 

"Where OD for Schools Needs to Go" will be presented by Richard 
A. Schmuck, University of Oregon. Although training in organization 
development for schools is a plausible and useful vehicle for humanizing 
staff and classroom climates, such interventions have only just begun 
and are immature, need to be broadened to include students, need to be 
described more objectively and in more detail; and should be 
disseminated to a much wider array of schools. 

Research and development on OD in schools is less than ten years 
old. Most of the early efforts in education have been narrowly guided 
by a set of assumptions involving trust and truth. Although this 
"tender" model has paid off, efforts should be made to develop and 
test interventions guided by other models such as those of power and 
conflict, product-accountability, and technostructural. 

Whatever model or combination of them is used, more projects 
should be tried in which students are included as trainees along with the 
professionals. 

OD consultants in schools should also describe their technique much 
more explicitly. Detailed descriptions are needed so that other less 
experienced consultants can use them, experimental replications of 
techniques can be carried out, and creative adaptations can be made for 
future designs. 

Most successful OD interventions in schools have apparently taken 
place in conventional suburban or small city districts with fairly 
substantial economic and attitudina! support for schools. The thrust for 
the future should turn toward large, urban school districts and 
"alternative-culture" schools aiming at the creation of highly individual- 
ized, open learning environments. 

Finally, more projects deliberately designed to establish groups of 
skilled OD trainers in school districts are needed. Assuming that it is 
feasible to install internal organizational specialists in many districts, 
each such group will gain legitimacy and influence as it is formally and 
regionally linked to other similar groups. 

"The Role of the Internal Change Agent in OD" will be presented 
by Car M. Foster, Chairman, Dept, of Organizational Development, 
Louisville Public Schools. Organizational Development rests on a set of 
basic assumptions about people and organizations. These assumptions 
involve the difficulty and complexity of change; coping with conflict 
resulting from change; a change for personal meaning, growth, and 
commitment; and a development of interpersonal conditions involving 
trust, openness, spontaneity, and participation. 

Basic to the strategy in OD is broad based participation in the 
effort. This quite naturally leads to a concern with role relationship; 
established relationship between peers, between different status levels 
within the system, and relationship between consultants and organiza- 
tional leaders. 

Much concern has been voiced about the dependency relationship 
between the members of the organization and the consultant. The 
nature of OD is such that this dependency on outside agents is 
somewhat minimized. 



One strategy in minimizing this still further is to create an in-house 
agent, a person to facilitate, to support, to encourage the OD effort, to 
help insure that changes continue after the consultant has gone. 

This discussion will center upon the efforts of one district to 
promote change by creating such a position. 

"The Change Agent as Advocate in Issues of Racism and Student 
Activism" will be discussed by Simon Wittes, Educational Change 
Team, Ann Arbor, Michigan. There is an intimate relationship between 
conflict and change. Although most change agents working within an 
OD framework would agree with this statement, there is much less 
agreement on the level of conflict that is desirable. 

If too much emphasis is given to conflict resolution, the system wiM 
only make minor adjustment in the status quo. 

Conflict can be delibating, but it need not be. Conflict is necessary 
for change and the more drastic the change the more intense the 
conflict must be before change will occur. 

Fear of confrontation and conflict tend to smother issues such as 
racism and student participation in school policy. 

The Educational Change Team is a group of consultants working 
within an OD framework as they assist educational systems in times of 
internal conflict and crises. 

This report will be a case study of an intervention in such a school 
system over a two year period. The talk will describe a systems 
approach using a team of consultants, each assigned to different role 
groups, and will report on the results of this effort. 

'The Product as Change Agent: Advantages and Limitations" is 
presented by Roger Rasmussen, Institute for Development of Educa- 
tional Activities. There are two distinct advantages which may be 
incurred in a successful attempt to "package" OD. First, and most 
important, it can be disseminated to a vast audience since it would not 
be dependent on close contact with outside consultants. Second, by 
necessity, it places a greater reliance on the members of the system. 
They must solve their own problems, must draw upon their own 
resources. 

This discussion will concern a two year project by The Institute for 
Development of Educational Activities to develop and test such a 
Pc.:kage. In particular, the report will deal with the problems of 
initiating collaboration of the school staff and systematic attack on 
their problems without direct intervention. It will discuss the effects of 
strategy utilizing teachers selected by their peers to serve as a 
"Development Team." 

'The Product as Change Agent: The Process of Development" will 
be discussed by Adrianne Bank, Institute for Development of Educa- 
tional Activities. 

Organizational development and product development in schools 
began approximately ten years ago. Up until the present time, the paths 
have not crossed even though the individuals working within each of 
these fields have many things in common. Organization development, in 
the words of Bennis, is a design to bring about change through the 
analysis of experienced behavior. 

Product development has been concerned with ways to produce 
materials that can achieve desired effects. In both fields there has been 
a commitment to work with educators in the schools. In OD the intent 
is for immediate effect and the purpose is to bring about change in the 
entire school. In product development the intended effect is for the 
future, the purpose being to test the effectiveness of materials which 
had been developed— usually classroom materials. 

The Institute for Development of Educational Activities project to 
develop a product broad in scope, a product with the purpose of 
initiating OD brought together individuals trained in both fields. This 
paper will report on the process of developing the materials on con flicts 
generated by the different purposes, and the complimentary aspects of 
organization and product development. 

These papers will be discussed by Matthew W. Miles of the State 
University of New York, Albany, and Charles 2. Wilson of the 
University of California, Los Angeles. 
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REORGANIZATION OF NATIONAL MINISTRIES OF EDUCATION: 
A CROSS CULTURAL EXAMINATION 

NAFTALY S. GLASMAN, University of California, Santa Barbara, 
ORGANIZER 

Developing nations seeking to modernize their social and economic 
institutions have been slowed by organizational infrastructures in- 
capable of supporting differential and evolving demands of a changing 
society. Educational reforms in these nations have been hindered 
because of similar difficulties. In an effort to overcome some of the 
difficulties, attempts were made in a number of nations to reorganize 
the national educational ministries. One objective of the symposium is 
to report on recent efforts of such reorganizations. Another objective is 
to examine the various cases in relation to theoretical and contextual 
foundations of organizational decision making and relationships among 
administrative roles. In this sense the symposium touches upon specific 
issues such as real and optimal degrees of centralization of deci- 
sion making; degrees of rational and functional authority structures; 
extents of integration of pedagogic, administrative and budgetary 
aspects of education ministries' roles; and structures of bureaucratic 
communication networks and workflows. 

The symposium consists of research reports from two South 
American nations and four Asian nations, which together represent a 
sufficiently large but manageable range of stages of economic and social 
development. The sample includes educational reorganization cases 
which are at different stages of implementation and which have 
achieved different measures of success. The six nations included are the 
Dominican Republic, Venezuela, Thailand, Pakistan, Indonesia and 
Israel. The symposium consists also of two discussants' presentations 
which constitute attempts to compare phenomena in the developing 
nations to similar phenomena in the United States. The American 
examples include one case at the state level and one case at the local 
level. 

"Inter-element Conflict in Education in the Dominican Republic 
and its Effect on Technical Assistance Programs" will be presented by 
Tom Arciniega, University of Texas, El Paso. The paper uses a systems 
analysis approach to analyze the interaction among 3 elements: an 
American university, USAID coordinators, and host country counter- 
parts. A typology of systems dysfunctions is constructed centering 
around conflicts over goals, evaluative criteria, professional autonomy 
and programs' regulations. Conclusions are related to the effectiveness 
of the administrative use of expertise in reorganization efforts. 
Recommendations are offered to increase this effectiveness. 

"Organizational Reform in Educational Change in Venezuela" is 
presented by Mark Hansen, University of California, Riverside. This 
presentation is an organizational analysis of the Venezuelan Ministry of 
Education and its efforts since 1968 to reform the educational 
institution into a flexible instrument capable of supporting the 
qualitative and quantitative multiplying manpower demands of the 
nation. Pre-reform problems are identified which relate to organiza- 
tional structure and administrative processes. Structural modifications 
created under the reform are examined. The reform is evaluated with 
respect to its adequacy in meeting demands being placed on the 
Ministry. 

"Educational Reorganization in Thailand" is the topic of Leslie R. 
Gue, University of Alberta, Canada. This study examines the develop- 
ment of diversified secondary education in Thailand. The analysis deals 
with the role of the national Ministry of Education in the allocation of 
material and human resources and with the role of foreign education 
experts who operate in the context of international aid programs. 
Emphasis is placed on the organizational characteristics of temporary 
systems which are designed to introduce educational innovations. One 
major conclusion is that these systems are delicate and vulnerable units 
with inherent problems in die organization. 

"Educational Administration in Pakistan: A Study of Reorganiza- 
tion and Reform" will be presented by Mohammad Wasiuliah Kahn, 



University of California, Berkeley. The paper summarizes national and 
provincial efforts since independence to reorganize the system of 
educational administration. It reviews recommendations made by 
several governmental committees and the extent of their imple- 
mentation. The focus is on pedagogic, administrative and budgetary 
functions of the Ministry of Education and Scientific Research in 
Islamabad and in the 5 provincial education departments. Specific 
issues discussed are the centralization-decentralization dilemma, com- 
munication in decision making, moral building and change. Conclusions 
are drawn with regard to increased efficiency and facilitation of 
educational development. 

"Administrative Strategies for Promoting Quality in Indonesian 
Higher Education" will be discussed by R. Murray Thomas, University 
of California, Santa Barbara. This presentation consists of the analysis 
of (a) pressures exerted to expand higher education opportunities; (b) 
sections of the Higher Education Law related to quantity and quality of 
education; and (c) organizational efforts of the Ministry of Education 
during the 1968-71 period to improve the quality of higher education. 
Emphasis is placed on the formulation of the consortia of colleges, the 
designation of several institutions as Centers of Excellence to guide the 
development of other schools, and the assessment of quality of 
institutions by Ministry appointed evaluation teams. 

"Reorganization of the Israeli Ministry of Education: Conflicts and 
Compromises in Relationships Among Administrative Roles" will be 
presented by Naftaly S. Glasman, University of California, Santa 
Barbara. This presentation describes the Ministry's 1969-70 reorganiza- 
tion plans and proposals and examines them as institutional responses 
to changes in elementary and secondary education. It also analyzes the 
1970-71 stage of the reorganization's implementation. Emphasis is 
placed on compromises between conflicting interests in relationships 
among administrative roles between and within the central office and 
the reorganized regional offices. One central conclusion is that selective 
elements of the structural change do not constitute a function of 
changing educational goals but rather a function of changing strategies 
to achieve existing goals. 

Ronald E. Blood, University of New Mexico and Robert E. Stout, 
Claremont Graduate School will discuss the papers. 

The symposium's importance is in its contribution to the further 
understanding of processes of organizational decision making in 
education and of role relationships in educational administration. The 
international setting allows for viewing the above in a theoretical 
context of comparative educational administration. More specifically, it 
facilitates the search for generalizations related to implications which a 
given stage of economic and social development has on the nature and 
effectiveness of education ministries' reorganization. 



SUPERVISION: THE NATURE OF THE INTERACTIVE 
PHENOMENA 

JOHN R. CRYAN, Syracuse University, ORGANIZER 

It is the general purpose of this symposium to present five research 
reports that are concerned with supervision and supervisor training 
(four cite data from the Blumberg system). They represent a different 
take-off point for the study of supervision than typically taken in the 
past. Whereas heavy emphasis is frequently given to prescription, that 
is, what "should" and "should not" be done, the emphasis and 
orientation here will be behavioral and interpersonal. The supervisory 
process is seen as working best when it is conceived of by both parties 
as a collaborative, problem-solving process. Student teaching, the 
vehicle for analysis in the reports to be presented seems to be 
appropriate in this respect. The specific purposes of this symposium are 
to: 1) demonstrate the viability of an interaction analysis system for 
use in supervision; 2) demonstrate the viability of analyzing verbal 
behaviors during dyadic conferences as accurate and objective indices of 
supervisory behavior and style; 3) describe supervisory verbal behavior 
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during dyadic conferences between college student teaching supervisors 
and student teachers; 4) describe supervisory verbal behavior during 
dyadic conferences between college student teaching supervisors and 
cooperating teachers; 5) investigate and assess the effects upon 
supervisors who engage in systematic analysis of their supervisory 
behavior during conferences with student teachers; 6) examine relations 
existing between supervisor verbal style and the quality of interpersonal 
relations perceived to exist between the supervisor and the student 
teacher; and 7) offer implications for the preparation and training of 
supervisors involved in the administration of teachers. 

"A Study of Verbal Behaviors Engaged in by College Student 
Teaching Supervisors in Dyadic Conferences with Cooperating Teachers 
and Student Teachers" will be presented by Joseph F. Rousseau of 
Keene State College. 

This presentation will focus upon supervisor verbal behavior during 
dyadic conferences between Elementary Education supervisors and 
student teachers, and these same supervisors with cooperating teachers 
in an attempt to discover if supervisors use different verbal behaviors 
with teachers of different status. Audio tape recordings of 63 
supervisory conferences were subjected to analysis by an observer using 
the Blumberg Supervisory Interaction System. Percentages of specific 
supervisory verbal behaviors with student teachers and with cooperating 
teachers were compared by means of t-tests. Results indicated that 
supervisors did behave differently when interacting with student 
teachers than when interacting with cooperating teachers. These 
differences will be illustrated through a discussion of the composite 
matrices. 

"Differences in the Verbal Behavior of College Supervisors Using the 
Blumberg System for Analyzing Supervisory Conferences and College 
Supervisors Using No Systematic Analysis" will be presented by 
Maureen L. Evans of Hofstra University. 

This is a report of a study conducted to assess differences in the 
verbal behavior between college supervisors who used the Blumberg 
system of analyzing the verbal interaction in their supervisory con- 
ferences and college supervisors who did not systematically analyze 
their supervisory conferences. Eight supervisors of secondary student 
teachers were taught to use the Blumberg system and were then asked 
to tape-record and code their conferences during the second half of a 
college semester. A computer program was written to assist these 
supervisors in compiling matrices of the coded conferences. A control 
group of eight supervisors continued with their normal supervising 
practices but did not attempt to analyze their conferences. A 
comparison was made between the two groups with respect of 
proportions of supervisor-talk falling into various categories and groups 
of categories. 

"Analysis of Verbal Interaction in Supervisory Conferences with 
Student Teachers" will be presented by John W. Wulff of New Paltz 
State College. 

This presentation will describe the results of a study similar in 
design to the study by Evans. An experimental group of college 
supervisors of elementary student teachers received training in the 
analysis of verbal interaction, analyzed their own verbal interaction, 
and considered the results of the analysis of their verbal behavior. The 
central purpose of involving college supervisors in implementing an 
instrument (Blumberg's Supervisory Interaction System) to analyze 
their verbal behavior is to improve their instruction of the student- 
teacher. The questions to be answered during this discussion are as 
follows: 

1. Do supervisors modify their verbal interaction after training? 

2. Is the student-teacher aware of such a process? Data from this 
and the preceding investigation should provide data in support of 
more systematic programs of preparation for supervisors. 

"Supervisor Verbal Style as Related to the Quality of Interpersonal 
Relations" will be presented by John R. Cryan of Syracuse University. 

Data were obtained from 25 college student-teaching supervisors 
and their student teachers in an attempt to investigate the relationships 
between the supervisor's verbal style and: 



1. The quality of interpersonal relations existing between the 
college supervisor and the student teacher; 

2. Student teacher perceptions of the college supervisors verbal 
style. 

Approximately 120 audio tapes were classified as to verbal style by 
the Blumberg Supervisory 1 nteraction System. Student teacher percep- 
tions of the quality of their interpersonal relations with their 
supervisors was assessed through use of the Barrett-Lennard Relation- 
ship Inventory. A third instrument, 'The Teacher Perceptions of 
Supervisor-Teacher Interaction" scale (developed by Blumberg) was 
also administered to the student teachers. 

Multiple regression analysis of the data provided support for the 
notion that supervisors need to pay considerable attention to the 
climate and interactive nature of their supervisory confrontations. 

"Interpersonal Perceptions as a Factor in Teacher Perceptions of 
Supervisory Style" will be presented by George A. Churukian of 
Virginia Wesleyan College and John R. Cryan of Syracuse University. 

It was the purpose of the study to establish whether or not teacher 
perceptions of supervisor style were related to the teacher perceptions 
of the quality of their interpersonal relations with their supervisors. The 
point of view taken for this study and different from similar studies in 
the past was that teacher perceptions of the supervisory style would be 
dependent upon the perceived quality of the interpersonal relations. 
The establishment of interpersonal relations was seen as occurring 
independently of productive interaction. 

Graduate interns (elementary and secondary) working with master 
teachers, in an Urban Teaching Program provided the data for this 
research. Each intern was asked to describe his interpersonal relations 
with his master teacher, on the Barrett-Lennard Relationship Inventory. 
Interns answered a second questionnaire about supervisor verbal style. 
This questionnaire (by Blumberg entitled 'Teacher Perceptions of 
Supervisor-Teacher Interaction) consisted of non-evaluative items de- 
scriptive of the supervisor's verbal behavior as "perceived" and 
"desired" by the intern. By comparing the "perceived" and "desired" 
responses a discrepancy score was developed and used as the dependent 
variable. The results indicate the need for further identification of 
required competencies in supervision as a means of increasing supervisor 
effectiveness. 

The educational importance of this symposium lies in the fact that 
it points to the complex and interpersonal nature of supervision. 
Beyond that, it offers data in support of the need for supervisory 
training which should be thought of as directly focusing on the 
behavioral patterns and communications climate in a variety of 
supervisory situations rather than in the usual hit-or-miss fashion. 

Arthur Blumberg of Syracuse University will discuss the papers. 

SYMBOL MANIPULATION AND INTERNALIZATION IN THE 
TRAINING OF EDUCATIONAL MANAGERS FOR PLANNING 

JOHN M. GOODE, American Management Association, ORGANIZER 

Although education has greatly increased its concern with planning 
during the past few years, the implementation of planning has been 
subject to many difficulties. One of the most troublesome problems 
that has faced the planner is that of making planning a way of 
organizational life and not just a semantic exercise that is applied only 
on limited occasions. 

It is the purpose of this symposium to consider this problem by 
examining two viewpoints of educational change and their implications 
in a model situation. These viewpoints are: (1) That organizational 
change is accomplished best by changing people first, (2) People and 
organizational change must be concurrent. 

"Leadership and Planning: A Model" will be presented by Raymond 
E. Klawuhn, American Management Association. This paper will 
present a model of planning implementation that makes use of the 
concept that for successful planning, the organization must be changed 




16 




I 



at the same time that people are changed. Specific implementation 
problems will be noted and discussion will be invited. 

"The Model and Reality" will be presented by Irving Herrick, 
Maryland State Department of Education. The methods of imple- 
menting a strategic planning system in a state department of education 
will be described. The implementation strategies will be discussed in 



terms of organizational change strategies and/or people change strate- 
gies. 

"An Analysis of Reality" will be presented by Lynn Tanner, 
Syracuse University. This paper will present an analysis of the change of 
attitudes that accompany the implementation of a strategic planning 
system in a state department of education. 





DIVISION B: 

CURRICULUM AND OBJECTIVES 

PAPER SESSIONS 

AESTHETIC AND MORAL CONCERNS 

Poetry Instruction: Its Effect on Attitudes Toward Literature and the 
Ability to Write Prose 

PHYLLIS P. SHAPIRO, Emmanuel College; BERNARD J. SHAPIRO, 
Boston University 

Previous research has shown that children could be taught to write 
poetry. The present study investigated the effect of such instruction on 
attitudes toward literature and the ability to write prose. Four 
fourth-grade classes were randomly assigned to experimental groups 
receiving the poetry instruction and corresponding control situations. 
Over the six-week treatment period, the experimental group made 
statistically significant gains in both tested areas, the control group 
making such gains only in prose writing. Comparatively, analyses of 
covariance indicated the superiority of die experimental group both in 
the ability to write prose and more positive attitudes toward literature. 

Axiological Implications of the Seven Most Widely Used Ninth Grade 
Literature Anthologies 

ELIZABETH C. JOHNSON, Greenwich Public Library System; 
JOSEPH C. JOHNSON II, Greenwich Public Schools 

The purpose of this study was to identify the most frequently used 
ninth grade literature anthologies and then delineate the values 
occurring therein in order to classify and categorize them according to 
the various philosophical systems reflected by values. The study had as 
an overall objective to make educators aware of the significant presence 
of values and value themes, implied behavioral paradigms (models), as 
manifested in philosophical categories in general, and ninth grade 
anthologies in particular. 

As the ninth grade reader studies his literature assignments, it is 
apparent that he is gleaning an unconscious set of philosophical values 
extracted from behavioral models. 

Curriculum and School-Related Attitudes 

JOEL WEISS and S. B. KHAN, The Ontario Institute for Studies in 
Education 

Affective behaviors are increasingly being viewed as important 
outcomes of education. It is assumed that curricular experiences in 
school situations are influential in the development of students' 
school-related attitudes. This paper presents a review of the research 
literature concerned with the influence of textbooks, curriculum 
programs and instructional strategies on attitudes toward school, 
subject-matter areas, and teachers. Included will be a summary of 
trends, possibilities for the classroom situation, and suggestions for 
future research. The presentation is drawn from the chapter entitled: 
"The Teaching of Affective Responses" to appear in the Second AERA 
Handbook of Research on Teaching . 

Toward the Development of Moral Principles: An Holistic Approach 

ELIZABETH LEON IE SIMPSON, University of Southern California 

Review of the scientific literature on moral judgment, as defined 
philosophically, reveals concern for a) the structure of the moral 
situation; b) interpretation of principles; and c), the ordering of values 
and principles constituting choices. A bi-fold theory is presented that 
moral development a) is related to level of phychic deprivation so that 
the development of autonomous, principled moralization may be 



interrupted, distorted, or permanently suspended by the failure of 
central need satisfactions which provide superordinate values, and b), is 
dependent upon the development of empathy through trial by fantasy. 
Correlational research using school samples is described and results 
reported. 



BEHAVIORAL OBJECTIVES 

Effects on Achievement of Possession of Behavioral Objectives and 
Training Concerning Their Use 

JEAN A. MORSE and MURRAY H. TILLMAN, University of Georgia 

Two levels of training involving information about behavioral 
objectives were followed by a learning task measured by test items 
which measured objectives which had been supplied to some subjects, 
along with other test items measuring material for which no subject 
received objectives. Subjects who received objectives performed better 
on test items which measured objectives, and performed better on those 
items than did subjects who received no objectives. These results are 
viewed as consonant with the mastery-learning model. The training 
program led to more favorable attitudes about behavioral objectives, 
but did not facilitate utilization of the behavioral objectives. 

The Effect of Behavioral Objectives on Student Achievement 

JAMES D. LONG and SCHUYLER W. HUCK, University of Tennessee 

The efficacy of behavioral objectives in improving student achieve- 
ment was assessed in a college setting. The Ss were 19 senior and 
graduate students enrolled in a research course in Educational Psy- 
chology. Ss randomly assigned to two groups were separated before a 
class session. One group received a list of precise instructional 
objectives, while the other group discussed an unrelated topic. The two 
groups were reunited, exposed to the same lecture, and then admin- 
istered a 12-item quiz covering the day's lesson. Results of an analysis 
of covariance revealed that behavioral objectives had a desirable effect 
on student achievement. 

Assessment of Cognitive Behavioral Objectives: An Essential Step in 
Curriculum Development and Change 

CHARLES A. WOODBURY, JR., and MILTON D. JACOBSON, 
University of Virginia 

Fundamental to curriculum development and change is the assess- 
ment of cognitive needs. Such assessment is often conducted by 
measuring cognitive behavioral objectives with standardized tests. Do 
items in these tests measure selected behavioral objectives or is it 
necessary to create criterion referenced tasks to assess pupil achieve- 
ment and their cognitive strengths and weakness? Validation data in a 
state-wide needs assessment study indicates tests lack sufficient validity 
to warrant specific test item-objective performance comparisons. 
Alternative means are suggested to identify cognitive status for 
curriculum change. 

The Effects of Behavioral Objectives on Achievement of High School 
Students 

JAMES C. YOUNG, Kern High School District; WILLIAM B. 
MICHAEL, University of Southern California; GRANT W. JENSEN, 
Kern High School District 

Do behavioral objectives when implemented in classroom proce- 
dures influence achievement of high school students? After prior 
training in writing behavioral objectives and constructing criterion- 
referenced examinations, 38 teachers in nine instructional areas were 
assigned randomly to experimental and comparison classes that were 



exposed to instruction implemented or not implemented, respectively, 
around behavioral objectives. Significant differences in mean scores on 
common teacher-made posttests built around agreed-upon objectives 
favored experimental groups in Mathematics (grades nine, twelve) and 
American History for middle-track and college preparatory students. 
No significant differences were noted in Composition, English, a 
Romeo and Juliet unit. Speech, or Typing. 

A Radical Look at Behavioral Objectives 

JOHN R. GINTHER, University of Chicago 

The difficulty of establishing a suitable level of definition of 
objectives is reviewed and the drift toward highly specific, and 
restricted statements of behavior is noted. The relevance of such 
statements to evaluation is acknowledged. 

These matters are reconsidered in terms of evidence and 3 kinds of 
fact used in law. The importance of inference in law is noted and is 
contrasted with the apparent tendency to avoid inference in evaluation 
by setting the definitions of behavioral outcomes at the levels 
mentioned above. 

Finally, the conclusion is drawn that current practices may be 
squeezing education out of our institutions, leaving only training 
programs. 



BILINGUAL EDUCATION 

The Language Issue and Curriculum Structure in a Developing Country: 
A Case Study 

MONA D. VALISNO and ANGELINA RAMIREZ, Presidential Com- 
mission to Survey Philippine Education 

The objectives of the Survey are to analyze the performance of the 
Philippine educational system and its relevance to development goals 
and to recommend specific ways of improving the system with 
particular emphasis on developing policies. Findings suggest that 
Philippino is the main medium of instruction at the elementary level, 
English and Philippino for secondary level and beyond. Educational 
significance of the study suggests that the Philippines will be producing 
citizens that will meet closely the fundamental objectives of Philippine 
education and students better prepared for college and the vocational- 
technical aspects of education. 

Analysis of a Spanish Bilingual Preschool Program 

THOMAS R. OWENS, Center for Planning and Evaluation, San Jose, 
California 

The operations and outcomes of the Spanish Dame Project, a 
preschool ESEA Title VII bilingual program in San Jose, California for 
children ranging in ages between three and five, are investigated in this 
study. A pretest-posttest control group design involving four exper- 
imental and four control groups was implemented. Children were 
grouped by age and type of program treatment. Bilingual preschool 
students demonstrated significantly greater growth in oral language 
than the three control groups. No significant gains, however, were 
noted for the bilingual kindergarten group as compared with the 
control kindergarten. 

A Study of the Cognitive, Affective and Socio-economic Factors 
Influencing Second-Language Acquisition 

CLARE BURSTALL, National Foundation for Educational Research, 
London 

This paper reports a 10-year programme of research into the 
teaching of French in British primary schools. A longitudinal study is 



being made of 18,000 primary school children, taught French within 
the context of a national teaching experiment. I nstruments to measure 
achievement in French and attitudes towards learning the language have 
been devised and administered to the experimental sample and to 
appropriate control groups. Achievement in other curriculum areas, 
teachers' attitudes and the organizational structure of the primary 
school have also been investigated. The interaction of cognitive, 
affective and socio-economic factors in second-language acquisition is 
illustrated with reference to the experimental data. 



CURRICULUM AND TEACHING 

A Methodology for Analyzing and Evaluating Teaching Strategies in 
University Science Teaching 

PHILIP G. BASHOOK, University of Illinois College of Medicine 

The study explored an approach to analysing and evaluating 
strategies for teaching physics concepts at the first-year university level 
based on B. O. Smith and co-workers conceptual framework of 
teaching. There were four phases to the methodology: identifying 
aspects of the theoretical work potentially useful for analysing and 
evaluating teaching strategies; evaluating actual teaching strategies for 
goodness-of-fit with an ideal; and suggesting specific problems for 
further investigation. The study represents an attempt to bridge the gap 
between a recent theoretical view of teaching and practical problems of 
classroom science teaching. 

Conceptualizing the Curricular Dimension of the Teaching-Learning Act 

ROGER V. BENNETT, University of Maryland 

Designing a comprehensive conceptual framework of the teaching- 
learning act, reviewing a research application of that framework, and 
evaluating the model were the purposes of this study. Theoretical 
constructs developed by four contemporary educators and empirical 
findings from several recent multidimensional studies of teaching 
provided foundations for the framework. Inter-relationships and inter- 
actions among curricular and instructional variables were established 
through conceptions of the "curricular dimension" and the teacher's 
"curricular organizing strategy." Application and evaluation led to the 
conclusion that the model provided a useful framework for planning, 
executing, evaluating and researching the teaching-learning act. 

Some Measured Effects of a Classroom Management Model Designed 
for an Individualized Early Learning Curriculum 

MARGARET C. WANG and MARIA MAZZA LOVE, Learning Re- 
search & Development Center 

This study investigated the effectiveness of a classroom management 
system for implementing an individualized early learning program that 
included the more "structured", "free exploration", and "inquiry 
oriented" learning activities. The research was conducted to determine 
the effects of changes made in a classroom management system from a 
"semi-structured" to a "free"-student initiated and student centered 
approach. We studied its effect on student learning outcome and the 
manner in which learning took place. An increase in rate of task 
completion during the experimental period suggests that the changes 
made in the classroom management model carry out the curriculum 
objectives of the program. 

The Relationship Between Elementary School Teachers' Assignments of 
Educational Priorities and their Practice: A tt Study 

PIERRE C. WOOG, Hofstra University 

This study investigated the nature of elementary teachers' priorities 
of behaviorally stated objectives of instruction and the practice of these 





priorities in the classroom. Thirty teachers, representing six school 
districts, were administered a one-hundred item structured Q-sort 
comprised of five theoretical categories; low cognitive, high cognitive, 
tool-skill, affective-personal, and affective-interactive. Statistical anal- 
yses revealed that twenty-six teachers ranked either the affective or 
high cognitive categories as most important. When these findings were 
correlated to classroom practice, no significant correlation, (r = -.150) 
was found v, tween these objectives teachers ranked as most important 
and those they practiced. 



EARLY CHILDHOOD 

The Effects of Teacher Presence on the Language of First Grade 
Children 

BARBARA KENEFICK, Boston University; JANE PAZNIK, Man- 
hattan Community College 

Groups of four first-graders, varied as to sex, race, and socio- 
economic status, were studied in four different language tasks in the 
presence or absence of their teacher. Results showed that the teacher 
significantly limited discussion among pupils, particularly for boys and 
cut-off imaginative role play twice as often as she initiated it. When 
problem solving was required, teachers did not model solutions, as did 
the children, but confined themselves to a question-answer mode of 
discourse. However, teachers encouraged patterns of descriptive lan- 
guage which seem to reflect a higher developmental level than those 
used by children alone with their peers. 

Implementation of Attention and Classification Curriculum in Day Care 
and Early Childhood Centers 

EILEEN M. EARHART, Michigan State University 

The Attention and Classification Training Curriculum designed for 
and field tested with Head Start classes was implemented in nine day 
care and early childhood centers to provide information regarding the 
suitability of the curriculum in the various settings. Data collected from 
taped interviews and questionnaires revealed that flexibility in a 
curriculum was considered most important by center personnel. 
Various organizational patterns were utilized in the centers. Younger 
children responded eagerly to simple short lessons while older children 
enjoyed the more complex problem solving activities. The training 
program fulfilled a need expressed by center personnel for appropriate 
curriculum with detailed instructions. 

CEMREL'S Language and Thinking Program: Some Preliminary Pre- 
School Findings 

HARRIET DOSS WILLIS, DAVID BUCKHOLDT, RICHARD ROBB, 
and WILLIAM WRIGHT, Central Midwestern Regional Educational 
Laboratory 

This study, conducted with Head Start classes of four- and five-year 
olds, six experimental and six comparison groups representing both age 
groups, was to investigate the effectiveness of CEMREL's Language and 
Thinking: New Directions Program, a broadly based instructional 
approach in the teaching of basic language and reasoning skills. 
Standardized instrumentation. The Apell Test, The Pre-School Inven- 
tory and The Peabody Picture Vocabulary Tests were administered in a 
pre-post design. Multivariate analysis of covariance shows significant 
effects due to the CEMREL curriculum. 



EXPERIENCE AND EDUCATION 

An Inquiry into Curriculum Theories and Open Classroom Practices 

NANCY L. DILL, Queens College, City University of New York 

Conventional curriculum theories, refined and made more complex 
over the years, are for the most part based on classrooms where 
teachers stand at the front of the room and confront all the youngsters 
with the same curricular unit at the same time. These theoretical 
constructs are inadequate when the framework of instruction becomes 
an open classroom. This paper is based on observations of open 
classrooms at the elementary level in the New York City area, using a 
modified form of network analysis to record data about curricular 
components focused upon in various activities and events. 

A Methodology of Experience, Part II: The Process of Inquiry 

WILLIAM E. DOLL, JR., State University of New York, Oswego 

This paper, a continuation of last year's, focuses on the process of 
inquiry as the key to a methodology of experience. As did the first 
paper it rejects the notion of pre-planned education, the result ot 
determining ends separately from means, and begins with inquiry as a 
natural function of man, but a function that needs development. 
Education as reflective inquiry was Dewey's emphasis in his later 
writings (especially his philosophical ones), and is Schwab's emphasis in 
his. This paper will study Dewey on inquiry, and then Schwab's 
interpretation and extension (in a school situation) of it. 

The Concept of Experience in Major Curriculum Literature: 1918-1970 

GEORGE WILLIS, University of Rhode Island 

This study analyzes the concepts of experience developed by 
nineteen influential works in curriculum theory during the period 
1918-1970, considering these concepts as functions both of statements 
about experience and of rationales for educational practice, and 
strengthening the hypothesis that during this period the field of 
curriculum theory has been generally ambiguous about the meanings of 
"experience" and about consistent educational practices. Beyond this 
finding, the study contains implications about the development and 
current state of the field, about the development of school practices, 
and about how educational practice might actually be conducted. 



FORMATIVE AND SUMMATIVE EVALUATIONS 
The Structure of Formative Evaluation 

JAMES R. SANDERS and DONALD J. CUNNINGHAM, Indiana 
University 

The need for a framework for discussing and organizing formative 
evaluation studies is evident from a search of literature written on 
formative evaluation. A structure for formative evaluation studies is 
presented. Four categories of formative evaluation activity are defined: 
pre-developmental, objectives evaluation, interim evaluation, and for- 
mative product evaluation. Within each category of activity, the 
methods of formative evaluation are discussed. Procedural implications 
for the formative evaluation of any phenomena are discussed. A 
two-dimensional matrix, with category of activity as one dimension and 
appropriate methods as the other dimension, is used to summarize the 
framework presented in the paper. 
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Formative Evaluation Procedures for the In-Context Development of 
Instructional Materials 

JUDY A. LIGHT, Learning Research and Development Center 

This study is involved with developing guidelines for using formative 
evaluation procedures in an on-going classroom. An attempt was made 
to identify, control and monitor the variables which effect academic 
performance. An analysis of test failures was used to identify 
weaknesses in the instructional system. Poor test performance was 
attributed to either errors in the design of materials or individual study 
skills. The use of formative evolution procedures in an on-going class 
were found to be effective in developing a satisfactory instructional 
system. 

S^mmative Evaluation of a Curriculum Developed to Prepare Day Care 
Administrators Using Mastery/Non-Mastery Criteria 

CAROLYN LIPTON ELLNER, Claremont Graduate School 

The objective of this inquiry was to evaluate the effectiveness of a 
curriculum designed to train day care center administrators. Using 
criteria referenced program objectives, pretest and posttest measures 
were constructed. A discussion of innovative measures utilized is 
included. Tests were administered to Ss prior to participation and at the 
end of the program. Using explicitly stated variables, test performance 
was rated on a mastery/non-mastery basis. Proportion of Ss achieving 
mastery of each objective on pre- and post-measures was computed. A 
test of proportion was applied to determine whether changes were 
attributable to instruction. Difficulties in methodology and mea- 
surement are discussed. 

Evaluation and the Diffusion of Educational Innovations 

H. HOWARD RUSSELL and KENNETH A. LEITHWOOD, The 
Ontario Institute For Studies In Education 

This study concerns development of a mode! for diffusing educa- 
tional innovations in a systematic and empirically validated, effective 
manner. Twenty-two schools are presently involved in the project with 
the addition of twenty in 1971-72. The elaborative formative and 
summative evaluation including student performance objectives 
criterion-referenced testing, and use of quasi -experimental designs 
distinguish this study from most diffusion studies. The program is 
distinct from most evaluation studies because of its integral use of 
evaluation in the basic processes of diffusion. Results of imple- 
mentation of I PI math and the Berieter-Regan Conceptual Skills 
Program, as well as others, are discussed. 



FUNCTIONAL LITERACY 

Reading Activities of American Adults 

AMIEL T. SHARON, Educational Testing Service 



The Development of a Collection of Adult Tasks for Assessment of 
Literacy 

REX JACKSON, Educational Testing Service 

The principal focus of the paper will be on the use of (1) the results 
of a national survey of reading activities, and (2) a panel of individuals 
from such fields as industry, education, government, and journalism, to 
identify critical and broadly applicable reading-dependent tasks that 
return significant economic or other benefits to the individuals who 
perform them. The paper will include preliminary results from field 
trials of these tasks. 

Variables Relevant to the Construction of Behavioral Objectives and 
Criterion Test Items for Reading 

JAMES L. EVANS, Individual Learning Systems 

A simple and inexpensive system for teaching adult literacy will be 
described. The system assumes reading as operant behavior, and is 
derived from a general model of operant learning. Relevance of the 
model to the construction of course objectives, terminal objectives, 
enabling objectives, and pre- and post-test criterion items will be 
described and illustrated by reference to a project to develop terminal 
reading objectives for the New York State Education Department. 

Evaluation of Terminal Objectives in Reading 

WILLIAM MELCHING, Human Resources Research Organization 

Recently the New York State Education Department undertook a 
large scale effort to develop terminal objectives in reading. This 
research, described by Evans, used a concept of terminal objectives 
developed by Ammerman and Melching. To insure the production of 
acceptable reading objectives, NYSED engaged Melching and colleagues 
to review and evaluate the objectives. This presentation will describe 
the activities and problems encountered in evaluating the objectives. 

Development and Evaluation of Job Reading Task Tests 

JOHN S. CAYLOR, Human Resources Research Organization 

This presentation will describe research to identify job reading tasks 
in three military career fields: Supply Clerk, Mechanic and Cook. Major 
methodological problems (conceptual and procedural) will be discussed. 
Development of Job-Reading Task Tests (JRTTs) will be described. 
Psychometric data relating performance among JRTT sub-tests and 
standardized reading tests will be presented and interpreted as 
indicating that performance on adult level job-reading tasks does not 
involve unique reading skills untapped by currently available norm- 
referenced reading tests. 



IMPLEMENTING CHANGE MODELS 

From Psychological Theory to Educational Practice: Implementation of 
a Matching Model 



A survey of a nationally representative sample of over 4,000 adults ^ DAVID E. HUNT, JO ANN GREENWOOD and RONALD BRILL, 
on what has been read during a 24-hour period is discussed as the Ontario Institute for Studies in Education; MICHAEL DENEIKA, New 

preliminary phase in the development of life-like reading tasks to be York Board of Education; BRUCE R. JOYCE, Teachers College, 

used in assessing adult literacy. The survey attempts to answer a variety Columbia University 

of questions about the reading habits of Americans and on how such 

habits promote the well-being of the individual and society. What are If psychological ideas are to be implemented into educational 

the purposes served by different kinds of reading? How much time is practice, more attention is required to the process of implementation, 

spent on various types of reading activities? And so on. Reading Likelihood of implementation is considered in terms of how the 

behavior must be studied as an integral part of an individual's genera! psychological idea is evaluated on four criteria— objective validity, 

daily activities of living. potential relevance, comprehensibility, and feasibility— and how ef- 
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fectively it is translated from a psychological to an educational 
perspective. The analytic system is illustrated by application to the 
implementation of the Conceptual Level matching model (which states 
that the higher the student Conceptual Level, the less structure required 
in his educational environment) to the organization and allocation of 
resources in an open elementary school. 

A Study of the Effects of the Installation of a Curriculum Engineering 
System 

GEORGE A. BEAUCHAMP, Northwestern University 

The study being reported is an investigation of the effects of the 
installation of a curriculum engineering system in a school district. 
Treatment effects are the organized procedures for curriculum planning 
and implementation functions and the specific actions taken by 
personnel in execution of the procedures. Specific objectives are to 
observe the effects of the treatments upon (1) attitudes of teachers 
toward teaching and participation in a curriculum system, and (2) 
actual behaviors of teachers as participants in curriculum functions. 
Analysis of preliminary data is discussed in light of the longitudinal 
design of the study. 

An Inquiry into the Time Utilization of Curriculum Consultants, When 
Implementing An Instructional Innovation, as Reported by Curriculum 
Consultants 

WILLIAM E. LOADMAN and JAMES M. MAHAN, Indiana University 

This study identified the activities and relative amounts of time each 
curriculum consultant used in the respective activities. These data were 
obtained from 53 schools in the eastern United States. over a one year 
period- Dependent measures of frequency and duration were analyzed 
via several one-way ANOVA's comparing data obtained from ''success- 
ful" and "unsuccessful" schools (school success defined by an 
independent observer). The results indicate that certain activities occur 
significantly more frequently and for longer time periods (or less 
frequently depending upon the activity) in the "successful" schools. 
These results are of critical import to persons concerned with effective 
teacher-consultant coordinated behavior. 

Development and Diffusion of Innovative Processes and Products 

KENNETH A. LEITHWOOD and H. HOWARD RUSSELL, The 
Ontario Institute For Studies in Education 

Objectives of the study are to generate a working model for 
development and diffusion of educational innovations, implement the 
emerging model in a typical school system and develop the model 
through field trials and analysis of evaluative data. The model, being 
tested in 17 schools, identifies the individual school as the major 
educational unit, the principal as central change agent and teachers, 
planning cooperatively, as those with major responsibility for program 
related decision-making. Modified working structures now consist of a 
liaison group responsible for facilitating cooperative interaction of 
project constituents for the purpose of solving common change-related 
problems. 



MODELS OF TEACHING AS A PARADIGM FOR TEACHER 
EDUCATION 

Models of Teaching as a Paradigm for Teacher Education 

BRUCE R. JOYCE, MARSHA WEIL, RHOADA WALD, and 
CHRISTINA GULLION, Teachers College, Columbia University 

The derivation of a series of theoretical models of teaching is 
described as is the structure of a teacher education program at 



Columbia University in which teacher candidates were instructed in 
teaching based on four models of teaching. Research emphasizing 
interaction analysis techniques is reported describing the teacher 
candidates' "normal" modes and their behavior when experimenting 
with each of the four models they were taught. The results indicate that 
a repertory of widely differing teaching models can be taught to the 
average teacher candidate despite a disparity with the "model" of the 
cooperating teacher. 



POTPOURRI 

An Identification of the Process Response to Taxonomy-Type Test 
Items 

JAMES J. DIAMOND, University of Pennsylvania; DAVID V. 
WILLIAMS, Ithaca College 

The present study involved an attempt to determine what cognitive 
strategies 1 1th grade pupils employ when responding to multiple-choice 
test items. Using a 50 item test based upon the Taxonomy of 
Educational Objectives and an earlier study of Kropp, et a/. (1966a), 
data from 71 pupils were assessed. The ratings of the students' written 
solution strategies indicated that, for only 6 out of the 50 items was 
agreement obtained between the intended and actual solution process. 
The results were interpreted in light of the study's internal validity and 
the reported need for assessment of areas other than recall. 

Curriculum Structure as Reflected in Perceived Cognitive and Affective 
Processes 

JOE M. STEELE, University of Co;orado; ERNEST R. HOUSE, 
University of Illinois, Urbana-Champaign 

Three empirical dimensions of curriculum structure are presented in 
this study of the differences among subject areas in student perception 
of cognitive and affective classroom processes. 

Class Activities Questionnaire items were used in obtaining data 
from 121 Illinois classes in Science, Mathematics, Social Studies, and 
Language Arts, grades 6-12. 

Utilizing discriminant analysis, the dimensions are: D1, "Inter- 
preting versus Analyzing," contrasts Language Arts versus Mathe- 
matics; D2, "Synthesizing versus Knowing," contrasts Language Arts 
and Mathematics versus Social Studies and Science; D3, "Exploring 
versus Evaluating," contrasts Science versus Social Studies. 

it appears that these school subjects place distinctly different 
demands on students. 

The Use of Smallest Space Analysis in the Development and Evaluation 
of a Hierarchical Chemistry Structure 

RICHARD B. SMITH and TIMOTHY SCHAAP, Northern Illinois 
University 

Junior high school chemistry was structured in a manner suggested 
by Gagne. A Concept Test consisting of combinations of three 
examples and nonexample items for each concept, and a Criterion Test 
which required 1) the recognition of the relationship stated in a 
different manner; 2) the extrapolation of the relationship; and 3) the 
recognition of when experimental data supports, denies or is irrelevant 
to the relationship were constructed. The subtests were then correlated, 
and the correlations subjected to Guttman-Lingoes, Smallest Space 
Analysis-1. The paper is a discussion of the resulting empirical pictures. 

Curriculum Design and Evaluation in an Alternative Urban School 

AASE ERIKSEN, University of Pennsylvania 

One of the problems encountered in a nongraded, heterogeneous, 
open classroom situation is the lack of support and resource materials 
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to help the teacher. Since the teachers in the West Philadelphia 
Community Free School have had to design their own units over the 
past two years, it was thought that some of these could be used for test 
purposes to determine whether it is feasible to pre-design units for such 
a situation. Therefore, the purpose of this particular curriculum project 
was to design units as resource materials which would be helpful to the 
teacher who could' reorganize the material to suit the teaching-learning 
situation. 



PROCEDURAL OPTIONS IN DEVELOPING CURRICULUM 

Procedural Options in Developing Curriculum 

MORTON ALPREN, Temple University 

The host of literature on curriculum and curriculum development is 
marked by an c-rrission and an oversimplification of an issue that will 
be dealt with ir oaper. The omission has been that of the options 
available to tnir.e who wish to develop curriculum. The over- 
simplification is the issue about whether teachers should or should not 
be curriculum developers. This paper will proceed by defining terms, 
examining the issue about teacher function in curriculum development, 
and then get on with the business of curriculum development options 
and applications of the options. 



READING 

The Useft&tess of Linguistically-Based Word Generalizations 

ROBERT EMANS and JEANNE McLAiN HARMS, The Ohio State 
University 

This investigation was a replication of previous studies by Clymer, 
Bailey, and Emans involving the usefulness of phonic generalization. 
However, instead of investigating commonly taught phonic general- 
izations, linguistically-based word generalizations were analyzed. 
Graded words beyond the primary level were used as the sample. As 
previous studies involving commonly taught phonic generalizations 
found many to have limited usefulness, this study found the same to be 
true with linguistically-based word generalizations. However, as was 
found in the previous studies, some of the linguistically-based word 
generalizations were found to be useful. 

Computer Simulation of Reading 

DONALD A. LETON, University of Hawaii 

A computer program (Simuread) has been written to convert 
English word orthography into segmented phonemes. The program 
accepts prespecified alphabet, punctuation and logogram input; and 
designates the segmental phonemes necessary for their representation in 
oral language. The program is an algorithm for the segmentation of 
graphic units within words and for the designation of phoneme chains. 
Numeral equivalents are used to simulate the segmental phonemes. 
Simuread has been developed to process primary grade level reading 
materials. Its application on word corpora from basic readers is 
illustrated. Portions of the graphic-phonic conditional association 
matrices are also presented. 

The Language Experience Approach for Teaching Beginning Reading to 
Culturally Disadvantaged Pupils 

POSE M. LAMB, Purdue University 

The purpose of this study was to investigate the effectiveness of the 
language experience approach to beginning reading instruction with ten 
classes of "culturally disadvantaged" pupils. It was hypothesized that 



the achievement of pupils using the language experience approach, as 
measured by the California Reading Test, would be superior to that of 
pupils using other, more traditional approaches and that the attitudes 
toward reading of the language experience pupils, measured by the 
Primary Pupil Attitude Inventory, would be more positive. Analyses of 
covariance and analysts of variance revealed almost no significant 
differences between the two groups. 

Goals and Objectives: An Analysis of Some Empirical and Conceptual 
Problems 

GEORGE T. WREN, University of Virginia 

In conducting evaluations within school systems, a primary concern 
is to determine whether or not objectives have been attained. This 
paper presents the results of the Virginia Evaluation Report on 
Performance Contracting in Reading, showing how standardized tests 
are inadequate as a measure of specific curriculum objectives. The 
empirical problems are used as a stepping stone for a conceptual 
analysis of the terms "objectives" and "goals," considering some of the 
normative and logical problems that arise. Is-ought components of 
assertions about goals and objectives are discussed. Also, the possi- 
bilities of specifying necessary and/or sufficient conditions are 
analyzed. 



SOCIAL ASPECTS IN CURRICULUM 

An Answer to a Challenge — Innovation in University Curriculum 

HANSOM P. BAPTISTE, JR. and CARMELITA O. MEINDL, Indiana 
University, South Bend 

It was hypothesized that individuals with a high personal and 
academic risk rating could succeed in a university program if the 
curriculum met the needs of these individuals. At this time 44 
participants have completed the first year of an innovative training 
program at Indiana University— South Bend. Data reflecting success in 
the university program have been analyzed. It was determined for the 
purpose of this study that a successful participant maintained a 3.0 
grade point average. The significance of this study is the success of high 
risk individuals in a university program training paraprofessionals as 
teacher aides. 

Assessment of an Intervention Curriculum Unit in Intergroup 
Education 

IRVIN DAVID GLICK and DEAN L. MEINKE, University of Toledo 

Eighty-six sixth grade boys and girls, ages 10-13, from an all white, 
suburban, high income residential area (experimental group), and 105 
sixth grade boys and girls, ages 10-13, from an all white, rural, low 
income residential area (control group) were administered a pre- and 
post-test measure (Paired Hands Test developed by Karl Zucker). The 
treatment was a seven step (or process) intervention curriculum unit. 
The findings using a two-way ANOCOVA strategy were: significant 
change toward increased friendliness for experimental subjects. 

Attitudes Toward Increased Social, Economic and Political Partici- 
pation of Women as Reported by Elementary and Secondary Students 

SELMA B. GREENBERG, Hofstra University 

Two objectives of this paper were: to discover pupils' perceptions of 
women's opportunities and abilities in comparison to those of men in 
the social, political and economic spheres and to determine if these 
perceptions are influenced by sex r grade or social class. Sixteen hundred 
students from 4 social classes and 4 grade levels responded to a 20 item 
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questionnaire. Although some attitudinal differences occur across grade 
and social class lines the major differences are found when the data is 
analyzed in terms of the respondents sex. Throughout the study female 
students respond more positively and optimistically to questions 
concerning abilities and opportunities for women than do male 
students. 

Self-Reported Perceptions: Current Status and Desired Roles in Student 
Autonomy 

RICHARD C. KUNKEL and JAMES H. McELHINNEY, Bai! State 
University 

This study attempts to examine the degree of school-related student 
autonomy in secondary school pupils. The study was part of a larger 
curriculum evaluation in Northwestern Indiana beginning in March 
1970 and ending in August 1971. Secondary students in 23 schools 
were surveyed by questionnaires and systemic interviews. The resulting 
evaluation is based upon the description of what pupils, teachers and 
other school personnel think is happening in schools. The level of 
autonomy among students surveyed varied in the different schools 
studied. The study would indicate there is little evidence of, yet much 
pupil desire for, increased pupil autonomy. 



SYMPOSIA 

THE ALTERNATIVE FUTURES OF CURRICULUM 

LOUIS J. RUBIN, Communication Coalition for Educational Change, 
ORGANIZER 

It is becoming increasingly evident that the school curriculum is 
faced with a number of alternative futures. The options are created in 
part by advances in learning theory, by the growing obsolescence of 
traditional patterns, by the changing nature of youth, by the potential 
of technology, and by fundamental revolutions in the social system 
itself. 

The immediate consequence of these alternatives is that curriculum 
design has been thrust into a state of confusion and flux. Whereas the 
curriculum scholar once was both theorist and designer, inventing 
programs of instruction according to an orderly rationale, he now finds 
it necessary to interpret and evaluate new curricula which evolve not 
out of a tested theoretical base but out of expediency, fad, the 
availability of machinery, the lust for change, the desire to guarantee 
learning performance, the willy-nilly application of experimental 
psychological constructs, and other irrational or at least disorderly 
procedures. 

Another immediate consequence is that curriculum has become a 
battleground for competing ideologies. There are those who advocate 
curricula based upon the precision and rigidity of proscribed learning 
modules, regulated through computers and daily diagnostics; those who 
advocate a form of schooling, characterized as "free", in which the 
child determines his own experiences; as well as those advocating 
education that is predominantly affective in nature, deferring to the 
psychotherapeutic and philosophical canons of humanistic psychology, 
and so on. 

And, of greatest importance, the cultural revolution ongoing in 
America has led to new and diverse value systems, and to the 
inevitability of a pluralistic society which cannot help but p?ace 
different and often conflicting expectations on its schools. 

It is not surprising, therefore, that the future of curriculum is 
indeterminate and chaotic. We cannot be certain whether the compar- 
atively carefully constructed curriculum projects of the 1950'sand the 
early 1960's will sustain their impetus, or whether they will be 
overshadowed by more recent and haphazard developments. Nor can 
we be certain that the need for authentic options and alternatives will 



not lead to curriculum designs that are merely shibboleths, stale ideas 
camouflaged with fresh intellectual varnish. 

The proposed symposium will examine these problems from 
different vantage points. While the arguments to be set forth by both 
the participants and the discussants may not be contradictory, they will 
at least illuminate the alternatives available and provide a platform for a 
general audience consideration of what may well become a decade of 
curricular crisis. 

Benjamin Bloom, University of Chicago, will argue that we are best 
advised to approach curriculum development through a series of 
national curriculum centers. In contrast, Joseph Schwab, University of 
Chicago, will argue that much of the recent activity in curriculum 
development has evolved from a scant knowledge base, lacking rigor, 
logic and the systematic use of workable theory. Louis Rubin of the 
Communications Coalition for Educational Change, espousing a rather 
different conviction, will maintain that— whatever else is done— the 
teacher in the classroom is the only real curriculum agent. In short, the 
curriculum is no more or less than what the teacher chooses to do. 

As discussants, Ralph Tyler of Science Research Associates, Elliott 
Eisner of Stanford University and John Goodlad of the University of 
California, Los Angeles, will comment upon these arguments, attack 
weaknesses, and seek to clarify the common ground. In addition, Tyler, 
Eisner and Goodlad will make appropriate references to the work of 
Bellack, Short, MacDonald and other curriculum theorists of note, as 
well as add insights of their own. In particular, Tyler will point out that 
while curricular diversity is essential, much of the so-called reform of 
curriculum has not provided schools with legitimate new alternatives, 
and that too much of the designers' attention has been preoccupied 
with matters that are largely trivial. Eisner will analyze curriculum 
development in England, relating the analysis to the points which have 
been raised and to common abuses of the concept of flexibility and 
openness. Finally, Goodlad will consider the organization of the school, 
administrative behavior, and public expectation in relation to all that 
has been said. 

The closing forty-five minutes of the symposium will be devoted to 
discussion from the floor. It is anticipated that the presentations will be 
sufficiently provocative to stimulate a sequence of lively dialogues that 
reflect broader points of view. Thus, it should be possible to clarify 
some of the more important defects of contemporary curriculum 
activity and to at least point the way for future endeavor. 



CONTENT ANALYSIS AS A TOOL IN FORMATIVE AND SUM- 
MATIVE EVALUATION 

HULDA GROBMAN, New York University, ORGANIZER 

Content analysis, a procedure for systematic categorization of verbal 
or behavioral data, is a potentially valuable tool for curriculum 
evaluation. While the technique has been developed and refined in 
communications and social science research, at present although a wide 
variety of other content analysis approaches useful in evaluation are 
feasible, interaction analysis is the only use being widely explored. The 
purpose of the symposium is to identify and explore aspects of this 
potential as well as examine some problems faced by investigators 
developing or adapting analysis systems. Through joint exploration by 
participants, discussants and audience, it is anticipated that a clearer 
definition of the potential for content analysis in curriculum evaluation 
will emerge. 

The first paper will be "Selective Survey of Content Analysis in 
Education, Communication and Social Science Research" by Hulda 
Grobman, New York University. The presentation will identify and 
assess some uses of content analysis in education to date and will 
explore some ways in which its use in communications research and 
social science research may be appropriate to or adapted for educa- 
tional evaluation. Treatment will be in terms of the kinds of questions 
that may be approached through use of content analysis and some of 
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the limitations in work previously done. Areas to be considered 
include: relative content emphases and cognitive level emphases; 
methodological orientation; implied or prescribed role of teacher and 
learner; learning theory implied; readability (appropriateness of vocabu- 
lary and situation in terms of discipline and target audience); affective 
overtones (including ideological value system, reward system, stereo- 
types, role models, value assumptions). 

A paper on the "Use of Content Analysis in Constructing 
Curriculum Models" will be presented by Anthony LaDuca, Center for 
Urban Education. Educational objectives have been defined by Tyler as 
statements of intended behavioral change in the learner. Assuming that 
the specification of teacher behavior appropriate to the accomplish- 
ment of the curriculum objectives is also required, it follows that the 
curriculum defines a teaching method. Using Gage's definition of 
teaching method as essentially equivalent to role behavior, the 
formulation of teaching models based on systematic behavioral content 
analysis of the curriculum seems strategically appropriate. 

An instrument, or analytical system, has been developed which 
permits analysis of curriculum materials for teacher behaviors in nine 
verbal and nonverbal categories. The categories include: asking open- 
ended and closed-ended questions; telling; verbal acceptance behaviors; 
knowing procedure or subject matter content; demonstrating; planning; 
and organizing. The instrument may be applied to a variety of 
curriculum materials, such as the teacher's edition of the curriculum 
textbook. Data derived from such analysis can be interpreted as 
defining the curriculum's teaching model. Thus, analysis of teacher 
materials of four junior high school inquiry science curriculum projects 
has resulted in the construction of three inquiry teaching models and 
the consistency between the teaching models and the respective 
curriculum objectives has been estimated. 

Definition of the curriculum teaching model facilitates formative 
and summative evaluation. For example, in the formative stages the 
curriculum developer may seek to determine consistency between his 
intentions (objectives) and his written instructions to the teacher. More 
appropriate to a 'summative evaluation is the formulation of the 
teaching model following curriculum development, so as to provide 
both descriptive and comparative data concerning the curriculum. 

The next paper is "Problems in Construction of Content Analysis 
Systems" by Arthur Lebofsky, Clarkstown, N. Y., Central School 
District. Content analysis in curriculum evaluation may demand 
singular solutions to problems of a type not encountered in other kinds 
of quantitative research. The presentation focuses on such problems as: 
definition of the parameters to be considered; selection of manifest or 
latent level analysis; appropriateness of the methodology to the 
evaluation purpose; delineation of categories appropriate to the 
purpose; sample selection; role of hypotheses; determination of 
instrument reliability through pilot study data; validation of instru- 
ment. Consideration of the selected problems is presented within the 
context of a study of prescribed teacher behavior. 

These problems impose serious limitations on content analysis 
methodology. However, within these limitations, data derived from 
manifest content analysis introduces a new dimension to formative and 
summative evaluation. 

The educational significance of the symposium is to direct attention 
to an underutilized tool for formative and summative evaluation and to 
identify new uses for this tool in such evaluation. Much of the 
evaluation activity of developmental curriculum projects in the past 
decade has involved classroom tryouts with gross or refined measures of 
student performance or of in-class behavior of teacher. Comparisons 
among curricula again have been based largely on limrted measures of 
relatively short-term teacher or student outcomes. There has been 
relatively little systematic evaluation to examine the curriculum itself in 
terms of congruence with stated or implicit intent of the curriculum 
builders or with external models or series of objectives of persons other 
chan the curriculum builders. While integrity of curriculum in terms of 
scholarly accuracy has been discussed, integrity in terms to other 



purposes has not. Establishing the integrity of the curriculum through 
content analysis should be a pre-condition to classroom testing. 

J. Richard Budd of Rutgers University and William V. Mayer of 
Biological Sciences Curriculum Study will serve as discussants. 



EDUCATIONAL RESEARCH AND SCHOOL SYSTEM INTER- 
VENTION: THE PLACE AND STUDY OF CURRICULUM DEVELOP- 
MENT 

F. MICHAEL CONNELLY, The Ontario Institute for Studies in 
Education, ORGANIZER 

The objectives of this symposium grow out of a concern that there 
appears to be very little progressive development in the capability to 
intervene in school systems. An historical perspective on curriculum 
development, suggests that the interventions that do occur amount to 
either taking up new locations on the same landscape or to reiterating 
old locations. Part of the reason for these characteristics is that there is 
very little research on curriculum development— e.g., on its assump- 
tions, processes, and interpretations by users. Consequently, little has 
been learned about development from the spate of projects in recent 
years. Still another reason is the existing separations in functional 
relations between educational organizations and between educational 
personnel with different roles. These separations reflect inadequate 
operating conceptions of the relations of research, development and 
school curriculum practices. 

Accordingly, the major objective of this symposium is to generate 
ideas on the study and place of curriculum development with respect to 
research and theory on the one hand, and school curriculum practices 
on the other. This will be done by bringing together people of different 
perspectives— Connelly, who views development from the perspective of 
choices and alternatives available to local teacher users; Walker, from 
the perspective of the committee deliberations of developers on 
projects external to school systems; Atkin, from an international 
perspective on the values and assumptions in development; and Chase, 
from an international perspective on educational policy making, 
implementation and eva!uation. 

J. Myron Atkin of the University of Illinois, Urbana-Champaign, will 
present: 'Value Questions in Curriculum Development: An Inter- 
national Perspective". This presentation is concerned with the value 
assumptions underlying curriculum development. A comparison of 
selected industrialized countries will illust^ re similarities and differ- 
ences in the purposes and modes of development and will serve as a 
basis for investigating broad differences in educational values which are 
associated with development in differing countries. Major decision 
points common to curriculum development in various countries will be 
identified and the values associated with the available alternatives at 
each decision point will be described. In keeping with one of the overall 
themes of this symposium, this presentation will attempt to evaluate 
the extent to which curriculum development contributes to the 
modification of practice in the various countries. Furthermore, it will 
be argued that certain sets of values, identified in the alternatives 
available during the process of development, contribute to more 
effective working relationships between researchers, developers and 
practitioners than do other sets of values. 

Francis S. Chase of the Southwest Educational Development 
Laboratory will discuss the topic: "Research and Development: Current 
Practices and the Evolution of A Systems Conception for the Future". 
This presentation will evaluate the reports and positions of other 
symposium participants in terms of their contribution to workable 
relations among researchers, developers and practitioners and in terms 
of their capacity to generate incremental and reconstructive changes in 
curriculum. A conception of curriculum treated as a system for 
monitoring learning environments will be advanced. This view involves 
alternative strategies and treatments joined in cycles by need assessment 
and feedback from learners. Major elements in learning environments 
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need to be identified in the process. This view necessitates the evolution 
of research and development practices including: 1) the development of 
new relations among educational personnel and among educational 
organizations, 2) the development of new roles and their associated 
skills for educational personnel, and 3) the development of new 
institutions. All of these developments are now visual in some form. An 
analysis of the factors likely to be instrumental in aiding and inhibiting 
the evolution of research and development practices will be presented. 

F. Michael Connelly of The Ontario Institute for Studies in 
Education will present the paper "Curriculum Development as a Form 
of Practical Enquiry: The Teacher as a Choice Maker". This presen- 
tation will argue that one of the major factors preventing progressive 
change in school curriculum practices is the periodic swing in the locus 
of curriculum development, i.e., locally by practitioners and externally 
by subject experts, and others, outside the school system. These swings 
reflect an inadequate operating conception between theory and 
practice. A view of curriculum development seen as a form of practical 
enquiry will be elaborated. This view treats research and development 
as interdependent activities and establishes organic connections be- 
tween research and school curriculum practices. From the perspective 
of the classroom teacher, this view suggests that the teacher not only 
understand the underlying choice points, but, in fact, make choices 
among alternatives for the particular curriculum situation in question. 
The rationale ana preliminary research findings in a study of teacher 
deliberation aimed at making practical curriculum choices will be 
presented. 

Finally, Decker F. Walker of Stanford University will present his 
paper: "The Study of Curriculum Development Projects". The pre- 
senter's research on the process of curriculum development in projects 
will be reviewed briefly as an example of current research in this area. 
The position will be taken that this line of research needs to be 
developed further, extended to previously neglected aspects of the 
process (such as materials construction and getting information on the 
effectiveness of materials in classroom use), and deepened to give more 
attention to the fundamental elements— logical, socio-political, and 
educational— of the curriculum development process. Methods will be 
suggested for making use of the insights gained in this research to 
improve classroom practice via the improvement of curriculum de- 
velopment procedures. 



EVALUATION EFFORTS IN LABORATORY AND RESEARCH 
DEVELOPMENT CENTERS: SOME EMERGING ISSUES 

WILLIAM J. WRIGHT, Central Midwestern Regional Educational 
Laboratory, ORGANIZER 

One of the most salient issues in contemporary curriculum 
development is the manner in which the sponsoring institution 
evaluates its own products. A variety of approaches are available and in 
use. In this symposium we propose to present several different 
evaluation strategies or models now in use at a laboratory or research 
and development center. The major thrust of the symposium will be an 
examination of each technique in terms of the audiences it serves and 
its heuristic value for other curriculum development efforts. Some of 
the issues to be considered will be the role of the evaluation staff with 
respect to the curriculum development staff, the function of internal 
evaluators with respect to product worth judgment or inferences, the 
need for experiments or quasi-experiments during various product 
stages, and the responsibility of the sponsoring institution to potential 
consumers. 

Robert J. Hess and William J. Wright, Central Midwestern Regional 
Educational Laboratory, will discuss "Evaluation Strategies as a 
Function of Product Development Stages." The point of view of this 
paper is that as products are cycled through developmental stages, the 
nature of the information required for an adequate evaluation changes 
as does the preeminent audience of any evaluation report. The authors 
contend that these changes are reasonably systematic and that by 



utilizing the notion of foreshadowing it becomes possible to structure 
evaluation such that the distinction between formative and summative 
evaluation becomes a question of purposiveness and not one of 
exactness. 

Ralph Hanson of the Southwest Regional Laboratory for Educa- 
tional Research and Development will discuss "Quality Assurance 
Procedures for Criterion Referenced Instructional Programs." The 
author will discuss the procedures used by the Southwest Regional 
Laboratory after program installation. They have found that an 
interactive process among laboratory and school personnel for the 
collection of information, primarily unit criterion and end of term data, 
has proven useful for both formative and summative evaluation efforts. 

Thomas J. Johnson, National Program for Early Childhood Educa- 
tion, will discuss "Evaluation in the Context of Product and Model 
Development in Laboratory and Research and Development Centers." 
An evaluation model designed to meet the unique responsibilities of 
government sponsored research and technology development organi- 
zations will be presented. The model deals explicitly with the issues of 
functional organization, policy review, and decision making processes as 
well as with more methodological issues related to data gathering 
modes, product characteristics, performance outcomes and their inter- 
actions. 

Louis M. Smith of the Central Midwestern Regional Educational 
Laboratory will present the paper "The Use of Observational Strategies 
for the Development of a Summative Evaluation Model." The author is 
currently engaged in the observation of an extended pilot trial of the 
CEMREL Aesthetic Education Program. One consequence of these 
efforts is to be a plan for the summative evaluation of that program 
which takes into account situational and locale contingencies. His 
contention is that participant observation will promote the discrim- 
ination of sub-projects and the priorities among these sub-projects such 
that subsequent trials can be more carefully designed and controlled to 
attend to the critical issues and concerns. 

Finally, W. Donald Hubbard, Thomas J. Fischbach, and Mary R. 
Quilling of the Wisconsin Research and Development Center for 
Cognitive Learning will present "Evaluation as an Interactive Force 
Between Developer and Consumer." A design strategy is discussed that 
proposes a systematic longitudinal interaction between the evaluation 
and development processes of an educational program. The usual 
sequence of pilot, small scale and large scale field tests is questioned. 
Included in this strategy are the formation of a broad range of terminal 
objectives, uses of control groups, variations in the mode of analysis 
and documentation of the marketing prospects of the product. 

Ralph W. Tyler, Center for Advanced Study in the Behavioral 
Sciences, Arich Lewy, Israeli Ministry of Educational Culture, and 
Michael Scriven, University of California, Berkeley, will discuss the 
presentations. 

The importance of the symposium rests in the intended exchange of 
information, and in the interaction of the various perspectives on 
curriculum evaluation in the specific context of a laboratory or research 
and development center. The discussants have been selected to 
represent diverse expertise in the field of evaluation so as to insure 
varied post-presentation discussion. The major consequence of the 
symposium hopefully will be the initiation of a continuing dialogue 
among those engaged in similar enterprises. 



OPERATIONALIZING AND IMPLEMENTING OPEN EDUCATION 

HERBERT J. WALBERG, University of Illinois, Chicago Circle, 
ORGANIZER 

In response to the growing interest in what has been termed Open 
Education (also known as British Infant Education, the Integrated Day, 
and the Leicestershire Plan), the participants have begun a variety of 
serious investigations of its distinctive characteristics and implementa- 
tion. 
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Open Education (henceforth, OE) is difficult to characterize in the 
manner that behavioral scientists are accustomed to operationalizing 
concepts, for the approach is founded upon contingency and unique- 
ness; each student, teacher, and event is sui generis. The feelings and 
behavior of the Open teacher cannot be easily categorized because her 
guiding principle is to respond as sensitively and reflectively as possible 
to the unique child at the precise moments in the temporal stream and 
situational Gestalt of her interaction with him. Also implicit in the 
approach is a view of the child, especially in the primary grades, as a 
significant decision-maker in determining the direction, scope, means, 
and pace of his education. Since there has been little research on OE, it 
seems fitting that a variety of methods of research, as exemplified in 
this Symposium, might be brought to bear on this challenging 
innovation. 

Judith T. Evan's (of Harvard University) paper "An Activity 
Analysis of British and American Open Classrooms" is a report on the 
range of activities and behaviors exhibited in open and traditional 
classrooms in the United States and Great Britain. From semi- 
structured classroom observation schedules, different profiles were 
developed and compared for the comparison groups stratified by social 
class. Providing a behaviorally-based definition of OE should increase 
our understanding of this approach to childhood education. 

Herbert J. Walberg and Susan C. Thomas' (of the University of 
Illinois, Chicago Circle and Boston Public Schools, respectively) paper, 
"Validating Eight Dimensions of Open Education", focuses on dimen- 
sions of OE derived from anecdotal literature and operationalized with 
classroom rating scales and a teacher questionnaire. Comparative data 
on OE and traditional classes. New York, London, and other cities 
reveals the consistency of the theory of the concept and its classroom 
practice. 

Richard Hirabayashi's (University of Illinois, Urbana-Champaign) 
paper, "An Ethnographic Analysis of Open Education", is an anthro- 
pological approach to the cultural and social context of the subjective 
values of teachers and students in OE classrooms. The micro-culture of 
the classroom is described in terms of specific observational categories 
which distinguish open and traditional classes. 

Steve Wlodarczyk's (University of Illinois, Urbana-Champaign)/ 
paper, "Analyzing Values in Open Education", exemplifies a philo- 
sophical approach to value analysis and seeks to identify the qualities of 
OE that are possibly antagonistic to traditional cultural values. Data 
from simulated events, rating scales, and critical incidents document the 
value and role conflicts emerging when implementing OE. 

Nettie R. Bartel's (Temple University) paper, "Individual Differ- 
ences in Open Education", explores how OE is being used in the 
Philadelphia Public Schools to reduce the labeling of deviant ("dis- 
turbed" or "under-achieving") children. Traditional and innovative 
teacher observation systems are used to document this provisioning for 
individual differences in open and traditional classes. 

Russel Cort's (of the General Learning Corporation) paper, "Class- 
room Support Strategies in Open Education," distinguishes the partic- 
ipatory problem-solving support model from the program installation 
model in implementing OE in the Washington (D. C.) Public Schools. 
Data on student ratings of classrooms, self-esteem, and reading 
achievement allow him to portray the contrasting implementation 
strategies. 

Bernard Spodek's and Theodore Manolake's (University of Illinois, 
Urbana-Champaign) paper, "In Class Teacher Training for Open 
Education," describes the distinctive training strategies required to 
develop behavioral repertories of teachers beginning use of OE 
methods. The focus is on the role fo the OE advisor and his relationship 
to the classroom teacher in effecting constructive educational change. 

Thus, the series of papers, moves progressively from behavioral 
analysis, through cultural and value description and provisioning for 
individual differences, to innovative support and implementation 
strategies. Since a number of educators are implementing OE and 
research groups are evaluating the concept, the variety of perspectives 



presented here will be of interest to those interested in reforming the 
schools in the direction of Open Education." 



OPPRESSION AND SCHOOLING 

JOHN S. MANN, University of New Mexico, ORGANIZER 

The title itself was problematic. It could have been Oppression in 
Schools, which would have suggested that "oppression" sometimes 
happens in schools more or less unintentionally and that appropriate 
reform measures should be taken to minimize occasions yf oppression. 
Or, it could have been The Oppression of Schooling, wh.:h would have 
suggested that Schooling per se is systematically oppressive. Or, it could 
have been Schooling as an Instrument of Oppression, which would have 
suggested the view that Schooling is an instrumental subsystem of an 
oppressive society. The three participants have each argued, at one time 
or another, on behalf of each of these three positions. They have argued 
with each other, with their students and colleagues, and with 
themselves. Their progress in these arguments is reflected in the choice 
of a symposium title which does not commit them specifically co any 
one of the three views. They all are very sure that in some fundamental 
ways schools do oppress. 

The purpose of the symposium is threefold: 

1. While the participants are uncertain about the forms, motives, and 
structures of oppression, they are very firmly convinced that 
regardless of its precise nature it is true that a primary (if 
unintended) consequence of most "scientific" research in education 
is to legitimize oppressive structures and practices. Thus they wish 
to engage scholars who are more accepting of "scientific" education 
research in consideration of the nature of oppression in the hope 
that they may go on to consider their own research effects in the 
context of its contribution to oppressive practices. 

2. Second, the participants wish to have their own thinking subject to 
the scrutiny of other educators who are interested in the notion of 
oppression but who have nox yet become actively engaged in inquiry 
into oppression. The scrutiny is expected to be useful to the 
participants in their own continuing work, and hopefully initial 
engagement in the topic will lead other educators to undertake their 
own inquiries. 

3. Finally, the participants hope to stir up some trouble in Division B, 
to get curriculum people to fight with each other publicly, 
forcefully, and intelligently. There is a tendency in the research 
community to conceal fundamental moral schisms behind agree- 
ment as to methodology, and to constrain public debate to details 
of findings and to technical deviations in method. There are 
undoubtedly contexts in which this pattern is not only acceptable 
but highly desirable. The contemporary curriculum research person 
who consumes a large proportion of those public resources which 
are allocated to education, and who serves an enormous turgid 
bureaucracy that is a principle factor in our society's provision for 
maturation of the young, does not provide such a context. Our 
nation is in a time of crisis, and there is a very rapidly expanding 
and broadly consumed semi-popular literature which argues that our 
schools are pivotal in this crisis. At such a time, the participants 
believe, it is appropriate for knowledgeable persons who have some 
influence upon our schools to address a portion of their energies to 
the task of questioning the fundamentals upon which their 
everyday enterprises might be allowed quietly to rest in quieter 
times. The notion of "oppression" provides one approach to such 
questioning. It is a matter of shaking us out of our everydayness. 
"Oppression" is a catchy word, dramatic and probably over-used. 

The participants would like to be understood to have three fairly 
precise meanings of the term in mind. The three meanings might be 
thought of as convergent or as divergent, depending upon what other 
assumptions one makes about human nature and society. The common 
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dictionary meanings include: "unjustly severe burden," "unreasonable 
imposition of authority," "burden of the spirit," etc. 

First meaning: Schools burden the mind of the child with data and 
operations that constitute a severe burden to the development of 
healthy and creative intellect. Of the many models available to 
illuminate this meaning, Lawrence Kubie's discussion of the effect of 
common schooling practices upon the development of a sound 
relationship between conscious and pre-conscious thought processes is 
perhaps the most useful. 

Second meaning: Schools burden the spirit of the child, depriving 
him of, and damaging his capacity for the richest sorts of human 
experience. The most useful models here are those provided by 
contemporary humanist psychology. The works especially of Carl 
Rogers, RoIIo May, and Herbert Maslow illustrate this sort of 
oppression. 

Third meaning: Most of the world's peoples suffer the oppression of 
unjust authority buttressed by unjust distribution of goods, privileges, 
and opportunity. Since school is one of the chief means by which 
societies perpetuate their institutional structures, it is reasonable to 
suggest that schools may contribute rather directly to these forms of 
oppression. Major portions of Marxist class analysis, the social criticism 
of Ivan Hitch, and the pedogogical humanism of Paulo Freire illuminate 
this meaning of oppression well. 

The Participants of this symposium are Michael Apple, University of 
Wisconsin; Richard Kunkel, Ball State University; John S. Mann, 
University of New Mexico; and William Pilder, Indiana University. Mr. 
Apple, Mr. Kunkel, and Mr. Pilder will prepare papers which we hope to 
have available before the symposium. Mr. Mann will respond to the 
three papers and raise questions about them, and develop discussion 
among the participants and the people in attendance at the symposium. 
We would like, by the end of the symposium, to have developed some 
topics and strategies for further inquiry. 



PERSPECTIVES ON MANAGEMENT SYSTEMS PROCEDURES IN 
EDUCATION 

ALBERT H. YEE, University of Wisconsin, Madison, ORGANIZER 

Schools have not lacked for contentious theories and research 
approaches to affect their organization and operations. Yet despite such 
variation, certain frames of references have dominated curriculum 
development and evaluation. Perhaps the best established practices stem 
from the scientific-economic-technological paradigm, which educators 
appear to accept without much challenge. However, lack of debate does 
not denote real understanding of why such practices should prevail. 
What typical educators do understand about empirical approaches does 
seem acceptable and compatible with the modern age in which we live, 
and they readily acquiesce to the expertise and judgment of researchers. 
The problem, therefore, becomes one of perspective and understanding 
what basic assumptions underlie curricular policies and programs. 

Becoming more knowledgeable in empirical techniques is not what 
is needed to overcome the problem we identify. Techniques in and of 
themselves do not provide the problems we wish to discuss, for their 
integrity rests as assumptions and proofs independent of application. 
Rather, it is how they are used that makes the crucial difference. 

Standardized norms, statistical analyses, experimental designs, 
behavioral objectives, evaluation, etc., have become routinized in 
American education. To many, such aspects of the scientific movement 
in education make it seem heretical to probe their prominent status and 
function. However, we would argue that few researchers, not to 
mention the typical educator, can provide much of a rationale for their 
use that is intellectually comprehensible in terms of the total and 
significant purposes of schools. 

Educational researchers must be able to defend and suppoit their 
conceptual approaches if they are confronted with questions asking 



why as well as how and preferably in that order. The latest 
developments have been management systems approaches and per- 
formance contracting. Growing quite naturally from technical proce- 
dures, they have been organized into a structure that strongly appeals 
to school and governmental leaders, e.g., ES '70 program, and 
epitomize how the scientific-economic-technological paradigm affects 
schooling. 

This symposium, therefore, will examine the meaning and impact of 
management systems approaches upon curriculum and instruction and 
try to provide wider perspective concerning their educational efficacy 
and relevance. 

The first paper will be "Object ives-Based Management Strategies for 
Large Educational Systems" by W. James Popham of the University of 
California, Los Angeles. Among the alternatives currently being 
considered by those educational planners attempting to devise sys- 
tematic management schemes for large scale educational systems are 
strategies which are focused on statements of instructional objectives. 
In several states, e.g., Florida end California, planning is under way in 
the state legislature to devise educational objectives. In large school 
systems, e.g., Los Angeles, comparable mechanisms are under considera- 
tion. 

This presentation will analyze the critical ingredients in using 
objectives-based systems for (1) goal determination , that is, decisions 
regarding the direction of the educational enterprise, (2) progress 
monitoring, that is, the formative evaluation of the system's en route 
success in attaining its goals, and (3) output appraisal , that is, the 
summative evaluation of the system's effectiveness. Several empirical 
studies, conducted by UCLA and the Instructional Objectives Ex- 
change, will be reported insofar as they bear on these three phases of 
large scale educational management. 

The second paper, "Adequacy of Systems Management Procedures 
in Education and Alternatives," will be presented by Michael W. Apple 
of the University of Wisconsin, Madison. Much of the recent thought in 
curriculum design and teacher education has drawn upon systems 
theory and analysis. However, little thought has been given to a number 
of rather important questions such as the adequacy of systems 
approaches itself in dealing with complex human phenomena. This 
paper will analyze the theoretical limitations of systems approaches in 
education as practiced today. For instance, a good deal of the use of 
such approaches in educational thought has been an inadequate 
representation and, often, a distortion of systems models. Furthermore, 
the utility of a systems approach, itself, will be examined in depth. 

Among the questions raised about the use of systems management 
procedures in education will be the following: (1) Are there logical 
difficulties in systems analysis which, when applied to educational 
issues, lead to problematic consequences? (2) Can systems management 
techniques adequately treat the moral dimension so closely intertwined 
with educational practice and decision-making? (3) Are there issues 
which must be dealt with more cogently than has heretofore been the 
case concerning the borrowing by educators of models and modes of 
analysis from disparate fields and applying them, in a relatively 
unsophisticated way to another somehow different area? 

The last paper, "Performance Contracting: Management Systems' 
Undoing or Ultimate Approach to Educational Revolution?" will be 
presented by Albert H. Yee of the University of Wisconsin, Madison. 
Conducted in a diverse and complex society or in a relatively stable and 
simple setting, education dictates purpose, organization, and teaching- 
learning processes. Curricular differences can be largely analyzed by the 
decisions and assumptions underlying them to decide what education is 
to accomplish and why, how schools and classes will be organized to 
achieve the desired effects, and the nature of actual teaching and 
learning to influence students. Therefore, schools by definition are 
operational systems. With the scientific-economic-technological frame 
of reference so predominant today, management systemization has 
captivated much of the educational leadership and its ultimate 
manifestation has become known as accountability and performance 
contracting. The concepts require careful scrutiny, for they seem to 
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epitomize the fundamental weaknesses and strengths of the scientific- 
technological managerial approach to education. 

This paper will outline performance contracting's purposes and 
procedures, indicate its roots and progress, and suggest its possible 
values and dangers. It will be argued that strict commitment to 
performance contracting falsely assumes that teachers can only be 
functionaries instead of professional leaders and that quantifiable 
behavior is most important educationally. The priority order in school 
organization, classroom processes and purpose must be reversed, not to 
negate proper system and order but to maximize instructional resources 
and alternatives for the social interaction of teachers and learners. 

Louis Fischer, University of Massachusetts, will serve as discussant 
for these papers. 



RESEARCH, SYSTEMS DESIGN AND THE FUTURE OF UNI- 
VERSITY COURSE EVALUATION 

G. H. ROID, McGill University, ORGANIZER 

Most universities and colleges in North America employ course and 
instructor rating systems. These typically involve a questionnaire given 
to students at the end of courses, the results of which are tabulated, 
summarized and sometimes published or distributed by student groups 
or Test Bureaus. 

Despite the current widespread use of course evaluation in colleges 
and universities, problems with the validity and usefulness of question- 
naires and rating systems still remain. 

In terms of validity, questions still remain concerning the dimen- 
sions of student ratings which are related to actual student learning. 
Most studies in this area have investigated the relationship between 
student ratings and final examination grades and have revealed 
moderate, sometimes inconsistent results. 

In terms of usefulness, consultants who work with users of ratings 
(e.g., an instructor trying to improve his course or a dean evaluating his 
department's teaching) have found that questionnaire results are not 
always easily translated into meaningful course improvement or 
behavior change in teachers. This may be due to a lack of attention to 
the systems aspects of course evaluation. Much of past research has 
focused on the psychometric properties {reliability, validity, norms, 
factor structure, etc.) of evaluation questionnaires. Recent develop- 
ments in evaluation theory would suggest that the questionnaire is only 
part of an evaluation process or system which includes initial 
specification of objectives and mechanisms for using evaluation da' \ > 
feedback. 

These problems imply a need for a concerted effort to change the 
direction and emphasis of planning and research on course evaluation. 
This symposium will serve as a forum for the presentation of new data, 
discussion, and suggestions for the future direction of work on the 
problems of effective course evaluation. 

Individual presentations will be made by investigators from several 
of the major course evaluation programs {both research and imple- 
mentation) in universities. 

Wilbert J. McKeachie, University of Michigan, will discuss "Student 
Evaluation Keyed to Function." Ongoing research in course and 
instructor evaluation is described in which multivariate discriminant 
analysis is used to identify evaluation questionnaire items that 
differentiate between teachers. Such items should hold information 
which is useful and not typically given by non-differentiating items. 
Studies in progress on the usefulness of differentiating items as 
feedback to instructors are described. 

W. G. Warrington, Michigan State University, will discuss "Per- 
spectives from the MSU Instructional Rating System." Empirical 
development of a four-part instructional rating system is reported and 
problems in its operation are reviewed. The system involves a rating 
form, computer tabulation program, user's manual, and consultative 
sessions aimed at helping the instructor evaluate and improve his 



teaching. Normative data on over 6,000 administrations involving over 
225,000 respondents have been collected. 

Elaine R. Parent and Keith Wharton, University of Minnesota, will 
present the paper, "Evaluation of Instruction: Communications for 
Improvement /Vow." The primary purpose of the evaluation of 
instruction is to improve instruction. The focus of the evaluation 
program should be on the individual teacher and his students within a 
given period of time (quarter or semester). The program should 
contribute to an open environment in which those students who wish 
to do so (many do not) have the opportunity to communicate their 
evaluations, suggestions and recommendations to the instructor at any 
time during the course. Evaluation should be low-key and informal, 
part of the "routine" of the class. Examples from the University of 
Minnesota are presented. 

Charles Van Horn, Purdue University, will present the paper, 
"Student Ratings of Teachers: Objectives, Objections and Implica- 
tions." Objectives set and assumptions made in development of the 
Purdue Rating Scale for College Teachers, the implications they yield, 
developmental steps taken in recognition of these, and unresolved 
questions remaining are discussed. Current status of scale validity is 
reported. The implications of widespread use of student ratings, some 
important objections raised, and some proposed inquiries are 
summarized. 

G. H. Roid, McGill University, will discuss, "Systems Design for 
Course Evaluation." Course evaluation should be viewed as a system of 
collecting information useful in decision making on the part of 
students, instructors and university planners. As such a questionnaire 
may be only a small part of a total system. Five steps in the evaluation 
of preconditions, process, and products of a course are defined as: (a) 
stating values, expectations and objectives from viewpoints of students, 
teachers, and planners, (b) choosing types of information and measure- 
ment methods, (c) collecting information at appropriate times, (d) 
interpretation of results, and (e) using data for change. The details and 
informal studies of these steps in an ongoing university course 
evaluation project are described. Suggestions for needed research are 
given. 

Richard Smock of the University of Illinois, Urbana-Champaign, and 
Charles Pascal, McGill University, will discuss the papers. 



THE RIGHT TO CHOOSE: VIEWPOINTS ON STUDENT CHOICE 
WITHIN COLLEGE COURSES 

JOY J. ROGERS, Purdue University, Calumet, ORGANIZER 

The objectives of this symposium include the following. Attendees 
will be able tc summarize the findings of existing research on student 
choice. Attenaees will be able to discriminate between studies of 
student choice as a variable of input, output, or process. Attendees will 
be able to identify major points of difference or conflict in the findings 
of studies on student choice. Attendees will be able to avoid some 
methodological pitfalls idiosyncratic to research on student choice. 
Attendees will identify student choice as an area in which further 
research is likely to be productive. 

The individual presentations are as follows. 

George L. Geis, Centre for Learning and Development, McGill 
University, will present, "Student Choice Viewed Operationally." This 
paper constructs an operational definition of student choice, casts 
current studies on choice into a consistent framework of research, 
points to a variety of suggestive studies and demonstrations, and 
provides a taxonomy of areas or variables which ought to be explored 
further. The purpose of this paper is at once to delimit "choice" by 
defining it rigorously and to expand research vistas by pointing to areas 
that legitimately fit the definition, but which remain unexplored. 

Charles E. Pascal, Centre for Learning and Development, McGill 
University will present, "Individual Differences and Student Choice of 
Instructional Options." This study identifies several differences related 
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to students' choice of three options: lecture, lecture with discussion, 
and independent study. Students preferring each option differ on 
dimensions such as flexibility, autonomy, preference for abstract 
thinking, and several variables dealing with academic and personal 
experience. Other research dealing with individual differences and 
student behavior are discussed and recommendations for practical 
application to the classroom are presented. 

Wayne K. Davis, Center for Research on Learning and Teaching, The 
University of Michigan, will present, 'The Effects of Student Selection 
of Learning Outcomes on Achievement and Attitude Measures." In this 
study, the effects of allowing student choice of learning outcomes on 
achievement and attitude measures were examined. The information 
sources preferred by the students in order to make these decisions were 
also studied. The position of this investigator is that independent study 
is not truly individualized unless the outcomes of the learning 
experiences are designed to meet the individual needs of the student. It 
is further argued that choice should not be a one time occurrence which 
commits the student to a course of action for an entire semester. Based 
on the findings of this study, it appears that students should be assigned 
instructor determined objectives and be allowed to determine their own 
means of achieving these objectives. 

Barbara J. Horn, Bureau of Hospital Administration, The University 
of Michigan, will present, "Course and Personality Correlates of 
Selection of Independent Study Option." The purpose of this study 
was to offer students two options in method for a course in library 
science and to explore the effects of choice on achievement, course 
satisfaction, and selected personality correlates. The subjects for this 
study were 12C graduate students enrolled in a course titled. General 
Reference Materials. Prior to the beginning of the course, students were 
offered the option of taking the course in the conventional manner or 
as an independent study course. Various personality measures were 
found to affect success in and satisfaction with the option that was 



chosen. However, some of these findings are in marked disagreement 
with other studies relating to student choice of independent study. 

David D. Starks, Center for Research on Learning and Teaching, The 
University of Michigan, will present, "A Menu of Objectives in a Large 
Introductory Course." This presentation assumes that student choice is 
of value in instruction and describes the design of a large (1,000 
students) course that permits each student to select those experiences 
and objectives he wishes to use in designing a personal course. In 
addition, the presentation will give attention to the numerous manage- 
ment and communication problems associated with the operation of 
the course. 

Joy J. Rogers, Purdue University, Calumet Campus, will present, 
"Instructional Options in a Psychology Course." This study is an 
investigation of students actual preferences from among an array of 
instructional methods. Findings indicate that students do display clear 
and consistent choices. Further, it is reported that students' actual 
choices are not isomorphic with their stated preferences on a 
questionnaire. Caution in instructors' reliance on "course evaluation" 
data is, therefore, advised. Implications of student choice for the design 
of instruction are suggested. 

Students are increasingly demanding greater control of all aspects of 
their education. Many renowned educators have spoken in support of 
this movement feeling, perhaps intuitively, that students can or should 
have this opportunity. Few, however, have made any systematic 
attempt to evaluate the effects of giving students choices. Student 
choice is unquestionably a difficult area for research. Since choices do 
not lend themselves to some of the more familiar techniques of 
experimental design and data analysis, researchers may have avoided the 
area in favor of more easily managed studies. The time for the 
systematic study of student choice, however, is late. If such investiga- 
tions do not soon begin, student choice may become nothing more than 
another of the hastily adopted and promptly abandoned fads with 
which the history of education abounds. 
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DIVISION C: 

INSTRUCTION AND LEARNING 

PAPER SESSIONS 

ANXIETY AND PERFORMANCE 

Effects of Anxiety and Item Difficulty Sequencing on Mathematics 
Aptitutfa Test Performance and Post Test Anxiety 

NELSON J. TOWLE and PAUL F. MERRILL, Florida State University 

Effects of item difficulty sequencing on performance and on post 
state anxiety were investigated using a timed mathematics aptitude test. 
The Ss were randomly assigned to a random, easy-to-hard, or 
hard-to-easy item difficulty sequence group. The hard-to-easy sequence 
group performance was significantly lower than either the random or 
easy-to-hard sequence groups. Though not statistically different, (1) the 
mathematics aptitude test scores of four achievement anxiety types 
grouped using the Achievement Anxiety Test, and (2) levels of state 
anxiety provoked by the three difficulty sequences were in the 
predicted direction. 

Effects of Anxiety on Quantity of Examination Preparation. 

ROY P. MARTIN and JOEL MEYERS, Temple University 

This investigation focuses on intensive study prior to an examina- 
tion ("cramming") and the effects of anxiety on the quantity of this 
preparation. One hundred female undergraduates were asked to record 
their anxiety and the amount of time studied on each of five days prior 
to a final examination. The quantity of study had a zero order 
correlation with performance on the examination, whereas quantity of 
study had a significant (pC.01) positive correlation with anxiety. It 
was concluded that last minute massive study may be an attempt to 
reduce anxiety, but it has no effect on test performance. 

An Investigation of Cognitive Abilities, State Anxiety, and Performance 
in a CAI Task under Conditions of no Feedback, Feedback, and 
Learner Control 

JOE B. HANSEN, University of Texas, Austin 

Ninety-eight undergraduate education majors received a battery of 
ability tests, measuring general reasoning (R), associative memory (Ma), 
and trait anxiety (A-trait) and were randomly assigned to 3 groups— no 
feedback (NF), feedback (FB), and learner control (LC)— for a CAI 
course on Xenograde systems. Four A-state measures were taken: (a) 
prior to the course, (b) following the administration of stress 
instructions, (c) at the mid-point, and (d) at the end. LC Ss decreased 
more in A-state than FB. NF remained high throughout the task. High 
A-state Ss made more errors under FB than NF. FB facilitated 
performance for high R Ss but impaired performance for low R Ss. 

Effects of Anxiety on Concept Learning 

JOEL MEYERS and ROY P. MARTIN, Temple University 

This study investigated the interactive relationships between state 
anxiety and concept learning performance. State anxiety was assessed 
five times during the performance of an extradimensional shift concept 
learning task which was administered under either high or low 
ego-involving instructions. State anxiety had significant debilitating 
effects on performance (p < .01 ; p < .03) whereas trait anxiety did not. 
Moreover, task conditions affected anxiety such that high ego- 
involvement produced a significant increase in anxiety. Also, poor task 
performance was associated with high anxiety (r = .49). It was 
concluded that these data support Spielberger's state-trait interpreta- 
tion of anxiety. 



Correlates of Classroom Social Climate with Student Achievement 

GARY J. ANDERSON, Atlantic Institute of Education 

With a sample of 64 secondary school classes, the predictive validity 
of a set of 15 learning environment scales was tested in eight subject 
areas: physics, chemistry, biology, geography, mathematics, English 
literature, history and French. Regression analyses showed the incre- 
mental validity of the scales administered at-mid-year to account for 
end-of-year achievement variance in class means beyond that accounted 
for by IQ. The results were compared for males and females, though the 
environment scale correlations with achievement were constant across 
class mean IQ levels and nearly constant across subject areas, several 
differences by sex were uncovered and related to the results of earlier 
studies. 



AROUSAL FACTORS IN LEARNING 

Cues Associated with Recognition of Aural Stimuli in the Primary 
Grades 

JANET B. KUENNE and JOANNA P. WILLIAMS, University of 
Pennsylvania 

How do children "recognize" words aurally? Using a matching 
technique, subjects chose, from a tape-recorded array, the CVC trigram 
that most resembled the stimulus item. Each choice represented one 
particular error in recognition, i.e., matching on the basis of single 
consonant phonemes, VC and CV combinations, and the reversal of the 
CVC stimulus. Developmental trends in patterns of choice from 
kindergarten through first to second grade, differences between aural 
and visual word recognition, and implications for instruction will be 
discussed. 

The Effect of Dissonance and Arousal on Assignment Performance as it 
Relates to Student Expectancy and Teacher Support Characteristics 

RAYMOND JOHN WLODKOWSKI, University of Wisconsin, 
Milwaukee 

A field experiment was conducted with 230 fifth and sixth grade 
male subjects to examine the relationship of two sets of variables as 
they affect performance on an arithmetic assignment. The first set of 
variables was the subjects' expectancy (positive or negative). The 
second set of variables was the dissonant or consonant expectancy of 
the experimenter regarding the subjects' performance. A one-way 
ano’ysis of variance for the comparison of mean gain scores was 
performed. The dissonant experimental groups did not significantly 
improve. Comparison of independent proportions was significant 
(p < .05) indicating that student level of arousal and task complexity 
affect achievement. 

Arousal and Cognitive Style 

JOSEPH A. SCOTT, Chico State College; FRANK H. FARLEY, 
Wisconsin Research and Development Center for Cognitive Learning, 
University of Wisconsin 

The effect of arousal manipulations on a measure of cognitive style 
was investigated in three experiments. On the basis of arousal, 
attention, and cue utilization theory it was predicted that increased 
arousal would render a S's performance increasingly analytic as opposed 
to globcl, field dependent as opposed to field independent. Auditory 
noise was used to manipulate arousal, with two intensity levels and a 
no-noise control. Cognitive style was measured by a Hidden Figures 
task. 

No consistent effect of arousal on cognitive style scores was 
obtained. Discussion considered possible deficiencies in the arousal 
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manipulation, and the stability of individual differences in cognitive 
style. 

The Drool Tool: A Brief, Reliable Measure of Individual Differences in 
Arousal 

FRANK H. FARLEY, Wisconsin Research and Development Center for 
Cognitive Learning, University of Wisconsin 

The usefulness of arousal analyses of learning and memory, 
emphasizing the promise of individual difference studies, was discussed. 
A brief, easily administered non-verbal measure of individual differ- 
ences in arousal— salivary response— was described. The relationship of 
this measure to retention in verbal learning paradigms was outlined. 
Studies from the author's laboratory were summarized concerning the 
measure's retest reliability, inter-judge or inter-tester reliability, and 
construct validity. The 24-hour stability estimate was .78 {p < .01), 
inter-judge reliability estimates ranged from .994 to .999 (p < .01), and 
the correlation with an independent arousal measure, the two-flash 
threshold, was -.57 (p < .01). 

The Electroencephalotopographic Correlates of Learning 

ROBERT L. EVERETT, University of Houston; JOHN W. OSBORNE, 
University of Alberta; WALLACE ANDERSON, University of Houston 

An experiment to evaluate the electroencephalograph ic correlates of 
free-learning tasks is described. Data was taken on a twenty channel 
topographic encephalograph, and initial analysis done by optical 
resolution of the frequency spectrum of the individual records, and the 
aggregate pattern. Correlation between electroencephalographic arousal 
states and free-learning task scores is observed for certain classes of 
subjects. Ability of the subject for continued concentration is evaluated 
by noting at which stage onset of EEG signs of fatigue are observed. 
There is a good possibility of an independent verification of the Shear 
effect, a synchronous, functionally located, learning correlated enceph- 
alograph ic signal. 

BEHAVIORAL OBJECTIVES 

The Effect of Presenting Instructional Objectives Prior to Reading 

R. KAPLAN and E. Z. ROTHKOPF, Bell Telephone Laboratories 

This study examined the effects of four characteristics of instruc- 
tional objectives presented to the student prior to reading, upon 
intentional and incidental learning. The most salient result was 
produced by providing instructional objectives to S prior to the text. 
The main findings were that (a) density increases (proportion of 
intentional to total sentences) resulted in a reduction of intentional 
learning but did not affect incidental learning; and (b) specifically 
stated objectives produced more intentional learning than general 
objectives. I ncidental learning was influenced by density and specificity 
of directions. This suggests that presentation of objectives will not 
interfere with incidental learning. 

Effects of the Use of Behavioral Objectives and Criterion Evaluation 
Upon the Classroom Progress of Adolescents 

A. BERT WEBB, Marshal! University; WILLIAM H. CORMIER, 
University of Tennessee 

The purpose of this investigation was to assess the effects of 
behavioral objectives and criterion evaluation upon the classroom 
progress of adolescents. Two eighth grade teachers participated, and 22 
students were the subjects. Four observers and one grader recorded data 
daily. The teachers were trained to write behavioral objectives and to 
employ criterion evaluation during treatment conditions. Analyses of 



variance showed significant differences in classroom behavior and in 
achievement. No significant difference was found in subject attitudes. It 
was concluded that the use of behavioral objectives and criterion 
evaluation had a positive effect on the classroom progress of adoles- 
cents. 

The Effects of the Placement of Objectives Within an Instructional 
Period and a Precriterion Test on the Acquisition of a Cognitive Task 

STEPHEN L. YELON and WILLIAM H. SCHMIDT, Michigan State 
University 

An experimental study was conducted to determine the relationship 
between the presentation of behavioral objectives given to the learner: 
1) at the beginning of the instructional period, 2) in the middle of the 
instructional period, or 3) in the middle of the instructional period but 
in the form of a precriterion test and the acquisition of a cognitive task. 
The experimental conditions were based on a factorial combination of 
the aforementioned three variables resulting in a 2^ design with eight 
treatment combinations. A multivariate analysis of covariance was 
employed to analyze the results. A significant three-way interaction 
between the variables was found. 

The Effects of Systematically Applying Instructional Objectives and 
Criterion Evaluation on the Classroom Behavior of Secondary Level 
Students 

JACK H. McEWEN and WILLIAM H. CORMIER, The University of 
Tennessee; THOMAS M. SHERMAN, Virginia Polytechnic Institute and 
State University 

I nstructionaf objectives and criterion evaluation were systematically 
applied to secondary level algebra classes. The effects on classroom 
behavior, test-scores, homework problems solved correctly, and the 
number of pages completed in the textbook were assessed utilizing a 
within class-reversal design. Observers and graders were reliably trained. 
The results demonstrated that instructional objectives and criterion 
evaluation were significant for all dependent measures. The findings 
emphasize the importance of communicating learning goals to students 
and providing the opportunity for students to remedy their 
deficiencies. 

The Effects of the Availability of Objectives on Performance in a 
Computer-Managed Graduate Course 

PAUL F. MERRILL and NELSON J. TOWLE, Florida State University 

The effects of presenting objectives to students in a graduate 
computer-managed course were investigated. The 32 Ss who registered 
for the course on Techniques of Programmed Instruction were 
randomly assigned to an objective group and a no-objective group. The 
hypotheses, based on previous laboratory studies, that objectives would 
decrease test-item-response latency, increase study time, and facilitate 
performance on unit tests were not supported. Objectives did signif- 
icantly reduce state anxiety; however even that effect diminished as the 
course progressed. Apparently graduate students are able to "psych 
out" a course very rapidly, and objectives have little effect. 



COLLEGE INSTRUCTION 

Evaluated and Non-Evaluated Higher Education 

WALTER M. VERNON and GARY C. RAMSEYER, Illinois State 
University 

University students were exposed to three conditions: a traditional 
grading system, a pass-no credit system, and non-evaluation. The 
amount of learning during a semester, as indicated by the percentage of 
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correct answers on seven examinations, was compared. There was a 
highly significant difference in achievement, p<.00l, with the 
traditional group being highest and the non-evaluated group lowest in 
scoring. Supplementary data established that actual study time 
paralleled the obtained achievement differences, indicating an apparent 
deficit in the motivation to study in both non-traditional groups. 

Selected Instructional Strategies in Computer-Managed Instruction 

R. MICHAEL LAWLER, University of Florida; WALTER DICK and 
MARION RISER, Florida State University 

One hundred sixty-seven undergraduates in a health education 
course were assigned to 4 treatment groups. One group received 
traditional classroom instruction (Cl) and served as a control. The 
remaining students were randomly assigned to one of three CM I 
treatments. For these latter students, the course was divided into 14 
modules with a total of 32 objectives. The results demonstrated a 
general superiority of the CMI groups. The CMI group provided with 
remedial prescriptions and required to reach mastery had significantly 
greater mean final examination scores than the group which was not 
required to reach mastery nor given prescriptions. 

Mastery Learning Options in Teaching Educational Psychology 

WALTER G. HAPKIEWICZ, Michigan State University 

A mastery learning strategy was employed in two successive terms in 
which educational psychology was taught to teachers. Various levels of 
mastery were specified and students selected the level of performance 
at which they wished to achieve. When compared to a more traditional 
course taught over the same period of time, students in the mastery 
group demonstrated superior achievement and expressed more positive 
attitudes toward the course. Given the instructional conditions nearly 
80% of the students elected to master the course at the highest level. 
This appears to indicate that requiring high levels of performance may 
be unnecessary. 

Achievement as a Function of External Organizers and Organizing 
Ability 

RICHARD A. GRABER, Illinois State College; ROBERTS. MEANS, 
West Chester State College; GLADYS H. MEANS, Cheyney State 
College; BILLY F. ELSOM and THOMAS JOHNSTEN, Oklahoma State 
University 

Ss (143) enrolled in an undergraduate chemistry class were rank 
ordered by their performance on a test of organizing ability. The 
median was used to form two groups— good organizers (GO) and poor 
organizers (PO). Ss within these groups were randomly assigned to 
treatments. Treatment I Ss received an advance organizer followed by a 
learning passage. Treatment II Ss received the same organizer preceded 
by the learning passage. Treatment III Ss received an historical 
non-organizer and the learning passage. No significant differences were 
observed on treatment or interaction, but GO Ss achieved significantly 
higher learning passage scores than PO Ss. 

The Effect of Continuous Progress Instruction on Acquisition, Transfer, 
and Retention in Introductory College Physics and on College 
Instructor involvement in Curriculum Development 

ELLEN D. GAGNE, J. WILLIAM MOORE and WILLIAM E. HAUCK, 
Bucknell University 

The purpose of this study was to determine the effects of 
Continuous Progress (mastery) Instruction on acquisition, transfer, and 
retention in an introductory college physics course. In addition, the 
effect on the professor of participation in curriculum development was 
observed. 



Freshmen were blocked on major and randomly assigned to 
Continuous Progress of Traditional Instruction groups. The Continuous 
Progress group showed greater acquisition, greater transfer to a related 
course, and greater retention a year later. Anecdotal evidence supports 
a more positive attitude towards Physics for Continuous Progress 
students. Also the professor involved in the experiment became 
involved in other curriculum experiments later on. 



COMPUTER ASSISTED INSTRUCTION 

A Comparison of Two Public School Computer- Assisted Instruction 
Projects 

SUSAN S. TAYLOR, DUNCAN N. HANSEN, BOBBY R. BROWN, 
Florida State University 

Two public school Computer-Assisted Instruction (CAI) projects, 
one in Kansas City, Missouri, and one in Wakulla County, Florida, are 
compared with respect to their different approaches to such problems 
as facilities, staffing, curriculum, operations, teacher involvement, and 
university-school district relations. In addition to a discussion of the 
developmental and operational differences, the results of each project 
are summarized and recommendations are made for future CAI research 
in a public school district. 

A Concept-Sampling Procedure for Quiz-Oriented Instruction 

DAVID W. McMULLEN, State University of New York, Stony Brook 

As a first step in developing an instructional support system that 
provides individual diagnosis and prescription within large classes, a 
concept-sampling procedure was developed in the context of frequent 
computer quizzes, each acting as an entry point within the system. 
From a bank of concepts and concept-properties related to a topic, a 
random sample was selected and presented with continuous feedback 
and scoring. Support strategies for those unable to "exit the system" at 
each point (i.e. pass each quiz) are described as implemented for an 
educational psychology course. Student reactions favored the proce- 
dure, though a number of refinements were shown to be needed. 

Program vs. Learner Control of Selection of Instruction and Amount of 
Practice in Computer-Assisted Instruction 

WILSON A. JUDD, University of Texas, Austin 

Conventional response sensitive branching algorithms were com- 
pared with learner control in a computer-assisted instruction (CAI) 
mathematics program. Two instructional decisions (whether to enter or 
skip an instructional sequence and when to terminate practice) were 
investigated in terms of student decisions, posttest scores and student 
attitudes. Interactions between control method and student ability level 
were also examined. In general, students were as effective as the 
algorithm in selecting instructional sequences but less efficient than the 
algorithm in deciding when to terminate practice. Complex interactions 
indicate a need for further research to define the role of learner control 
in CAI. 

The Yoked Control for Assessing Branching Effects: Does Individuali- 
zation Help? 

JAMES G. HOLLAND and JEANNE SWtCKARD HOFFMAN, Learn- 
ing Research and Development Center 

An especially efficient branching procedure (binary search) was 
compared with a control group in which each individual was randomly 
paired with an experimental subject. The match-mates in the two 
groups received identical sequences of items but the sequence was 
adaptive only to the measured needs of the branching group. No 
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differences were found in posttest performance between branched and 
yoked subjects although a linear version of the program was superior to 
both. The merits of adapting to individual differences should no longer 
be accepted on face validity. A yoked control is necessary. 

The Development and Evaluation of a Model for the Teaching of 
Beginning Shorthand Through the Use of Computer Assisted 
Instruction 

KARL G. BORMAN, Pennsylvania State University 

The learning theories of Guthrie, Voeks, Sheffield, and Skinner were 
used to formulate a model for the teaching of beginning shorthand 
through the use of CA1. Response latencies were used to predict 
incorrect responses. Each response not completed within the amount of 
time required for a correct response was predicted to be incorrect after 
which the subject was shown the correct response and prevented from 
completing the response. Results indicated that the "interception" 
method of instruction required more time, a greater number of correct 
responses, and a lesser number of incorrect responses from the subjects 
than other methods of instruction. 



A COMPUTER PROGRAM FOR 
DETERMINING WORD DIFFICULTY LEVEL 

Natural Language Computerized Comparison of Word List Content 

ALBERT J. HARRIS, City University of New York; MILTON D. 
JACOBSON, University of Virginia 

This study involved the development of a natural language computer 
program which could be effectively used to compare the content and 
reading level assignments of words in vocabulary and word association 
lists. A description is provided of the results of using the program 
successfully to compare four major word lists developed for use in the 
construction of elementary reading material. The program produced a 
printout of the list, indicating matched and unmatched words, and 
tallied information regarding the reading level assignments of the words 
in the lists. 



CONCEPT ACQUISITION 

Vicarious Transfer of Rule and Attribute Learning with Low and High 
Level Concepts 

RICHARD T. WALLS and STANLEY H. RUDE, West Virginia 
University 

The study assessed contributions of rule and attribute learning to 
solution of low (conjunctive) and high (conditional) level concept 
attainment problems. Models yoked to observers attained an initial 
concept followed by intrarule transfer to a problem solved by both 
models and observers separately. The findings coupled with a previous 
study provided a close replication of early work, in rule and attribute 
learning, with complete learning being more difficult than rule or 
attribute learning. While conjunctive results were remarkably similar for 
models and observers, high level concept learning required more mean 
trials and yielded more mean errors, without exception, for observers 
than for models. 

Vicarious Transfer of Low and High Level Concepts 

RICHARD T. WALLS and STANLEY H. RUDE, West Virginia 
University 

The present experiment compared (a) direct learning and transfer of 
models with (b) vicarious learning and transfer of observers. Subjects in 



the latter condition observed yoked models solve the initial problem 
before solving the transfer task themselves. High (conditional) or low 
(conjunctive) level concepts were attained by adult subjects in two 
successive intrarule concept attainment tasks. As imitation theory 
predicts, models in the high level concept condition showed large 
positive transfer effects; while this effect for observers was non- 
significant. However, with the easier concept rule, similar results 
occurred for models and observers. Implications for further research 
and classroom processes are discussed. 

Transfer of the "Concept" of Class Inclusion 

JOHN T. MOUW and JAMES T. HECHT, Southern Illinois University 

The major purpose of this experiment was to investigate whether 
tile ability of organizing elements into a hierarchical system or class 
inclusion ability could be transferred to a classification task using novel 
stimuli. The third and fourth grade subjects who were trained showed a 
strong treatment effect. It was concluded that the results support 
Gagne's cumulative learning notion of operations rather than viewing 
operations as maturational. 

Conceptual Learning and the Self Concept 

DEAN L. MEINKE, University of Toledo 

Ss were classified as positive or less positive self concepts by a Q-sort 
technique. Instructions and a principle were manipulated in concept 
attainment tasks. Positive self concept Ss attained concepts significantly 
faster and offered fewer hypotheses than lower self concept Ss. 
Significant effects were found for instructions and the principle. Ss 
became more efficient as the number of concept problems increased. A 
significant instructions by principle by repeated measure effect was 
found on time to criterion. For number of cards and amount of 
potential information there was a significant self concept by principle 
by repeated measures interaction effect. 

The Effect of Risk on Concept Acquisition 

W. BARRY BIDDLE, J. WILLIAM MOORE, WILLIAM E. HAUCK, 
Bucknell University; JOHN C. HOUTZ, Purdue University 

Thirty-six ninth-grade students of average IQ were randomly 
assigned to six treatment groups. Two groups received good positive 
instances (GP), two good negative and good positive instances (GN) and 
two poor negative and good positive instances (PN). One group of each 
set performed under risk conditions and the other under non-risk 
conditions. All Ss were shown instances of concepts made up of 
geometric figures. Risk Ss were given money which was taken away for 
wrong guesses and new instances. Non-risk Ss were given money for 
each concept correctly identified. It was found that Ss using GP 
instances performed best and that risk interfered with the use of GN 
instances. Risk did improve the performance of GP and PN Ss. 



CONCEPT LEARNING 

Cognitive Style and Conditional Concept Learning 

J. KENT DAVIS, Purdue University 

The primary purpose of this study was to empirically determine 
whether or not an individual's cognitive style differentially influenced 
his performance on an easy or difficult conditional concept learning 
problem. Thirty-six analytic and thirty-six global subjects learned one 
of two problems. The major results showed that analytic subjects 
performed significantly better than global subjects on the easy problem, 
but that there was no significant differences on the difficult problem. 
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The results are discussed in terms of different learning strategies 
employed by analytic and global cognitive styles. 

Cognitive Style and inquiry Strategy: A Five Year Study 

NORVAL C. SCOTT, JR., Wayne State University 

The purpose was to determine the longitudinal effects on the 
Inquiry Strategy Method on the pupil's styles of categorization. Two 
groups of inquiry students (experimentals) and non-inquiry pupils 
(comparisons) were soministered the Sigel Cognitive Style Test (SCST). 
The longitudinal groups of experimentals and comparisons had the 
SCST in 1966 (seventh grade) and in 1971 (high school seniors). The 
cross sectional groups had the SCST in 1970 (high school seniors). 
Chi-square indicated that both Inquiry groups were significantly more 
analytical in styles of categorization than were the comparison groups. 
Implications for analytical style are discussed. 

The Effect of Stimulating State Epistemic-Curiosity on State Anxiety 
and Performance in CMI Learning Tasks 

DARLENE L. HEINRICH and DUNCAN N. HANSEN, Florida State 
University 

An investigation of the effects of stimulating state epistemic 
curiosity on states of anxiety and short and long term retention was 
conducted using CAI Health Education course modules. Curiosity 
stimulating introductions to modules were found to significantly reduce 
state anxiety while high curiosity states were associated with higher 
short term retention, but lower long term retention in comparison with 
low state curious subjects. Significant interactions were also found 
between Anxiety and Curiosity Traits, and related measures of states 
and performance. Regression analyses were used to study the relation- 
ship of variables for prediction in optimal arousal models of learning. 

Individual Differences in Preference, Saliency and Concept Identi- 
fication Performance 

GERALD J. CASON, University of Texas, Austin 

Previous studies obtained good estimates of dimension saliency for 
groups on the basis of concept identification problem (CIP) data. 295s 
were given 12 CIP defined on 4 binary dimensions and a choice test 
(CT) based on the method of modified triadic comparisons. Analysis of 
variance on CIP data yielded a significant (p < .01) preference for the 
relevant dimension effect. The mean of the saliencies estimated from 
CT data for individual 5s on the dimensions number and shape were,as 
expxted, not significantly different (p > .30) from the group estimates 
derived from CIP data. Evidence was found indicating heterogeneity of 
saliency. 

Coping Style, Sense of Competence and Achievement 

GUY J. MANASTER, University of Texas, Austin 

The purpose was to test four hypotheses relating children's coping 
style and sense of competence (as measured by a projective. Story 
Completion, instrument) and their school achievement, and thereby to 
test a predictive model. Two hundred fifty 10 and 14 year old male 
subjects completed the instrument in class. Reliability of combined 
coping style and sense of competence variables was determined. 
Correlation and regression analyses were used to test and confirm all 
hypotheses. A new model with three types of coping behavior 
influencing achievement, while still assuming achievement behavior is 
dictated by sense of competence, is presented. 



CONCEPT LEARNING II 

The Effect of Review Techniques and Instance Presentation on Concept 
Learning Tasks 

JON I. YOUNG, Brigham Young University 

This experimental research tested eight hypotheses relating mode of 
instance presentation, review techniques and probability levels of 
instances. Identification of trochaic meter poetry was the experimental 
task. One hundred and thirty 5s were randomly assigned to twelve 
treatments and one control. Results are being analyzed by a three-way 
analysis of covariance on pre- and posttest scores, and analysis of 
variance on posttest and learning scores. Preliminary results indicate 
that simultaneous presentation is more effective than sequential 
presentation, and specific review produces fewer errors than no review. 
Undergeneralization errors occur with sequential presentation and 
review compensates for high probability instances. 

The Effects of Different Types of Positive and Negative Instances in 
Concept Learning 

JOHN C. HOUTZ and J. WILLIAM MOORE, Bucknell University; J. 
KENT DAVIS, Purdue University 

Two different types of positive and negative instances were 
constructed, based on the structural relationships between successive 
instances in a learning series. 171 eighth-graders were given series of 
only positive instances or alternating positive and negative instances of 
different types. Non-dimensional concepts were used to more 
accurately approximate school-related concepts. Most effective learning 
occurred from series of only positive instances which shared no 
irrelevant attributes. Most effective learning occurred from series of 
alternating positive and negative instances when the negatives were 
identical to the positives immediately preceding them in every attribute 
save one, omitted relevant attribute. 

Pictorial Mode of Rendition and Associated Responses 

NORMAN C. HIGGINS, Arizona State University 

This study sought to determine whether selected modes of rendering 
illustrations effected the number and nature of descriptive adjectives 
evoked in a restricted verbal association task. Stimulus-objects rendered 
as color photographs, black and white photographs and line-drawings 
were presented to 5s with instructions to write as many adjectives 
descriptive of the object presented as possible in a 30 second Uv;erv3l. 
Repeated-measures analysis of variance indicated that differences in 
number and nature of responses could be attributed to both mode of 
rendition and stimulus-object employed. The findings and scaling 
procedures employed are discussed. 

The Effects of T/pe, Identifiability, and Variety of Instructional 
Instances on Subject Matter Concept Attainment 

R. CARL HARRIS, Pennsylvania State University — ' 

Subject matter concept attainment by adult 5s was studied by 
experimentally manipulating instructional instances which were either 
positive or negative, clear or obscure, or presented in large or small 
variety. Training and testing instances were composed of case studies 
communicated via prose descriptions that had been analyzed for 
relevant and irrelevant attributes. Conceptualization was defined as 
generalization within and discrimination between classes and was 
assessed by having 176 undergraduate volunteers classify new positive 
and negative case studies after instruction from a definition and 
selected instances. Two, three-way ANOVs followed by t-tests revealed 
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that instance type, identifiability, and variety have differential effects 
on generalization and discrimination. 

Hypothesis Generation, Evaluation, and Memory Abilities in Adult 
Human Concept Learning 

CAROLYN L. CASON, GERALD J. CASON, DICK CALKINS, 
MICHAEL C. PELFREY, ROBERT J. COSTELLO, and JANINE 
BETHSCHEIDER, University of Texas, Austin 

Previous studies using alphabetic stimuli (AS) found 3 abilities 
associated with concept learning problem (CLP) performance. 134 Ss 
assigned randomly to 2 treatments: (a) information on CLP solution 
provided and (b) no information provided took identical AS and 
numeric stimuli (NS) ability tests and NS CLP. Factor analysis of the 
ability tests yielded the 3 hypothesized factors. Analysis of variance of 
CLP data revealed a significant treatment effect and evaluation by 
generation interaction. The non-significant treatment by generation 
interaction was nevertheless in the expected direction. CLP per- 
formance was associated with cognitive abilities in 2 content domains. 



CREATIVITY 

Relationships Between Figural Creativity and Grades in a College of 
Fine and Applied Arts 

WILLIAM M. STALLINGS and GERALD M. GILLMORE, University 
of Illinois, Urbana-Champaign 

A Torrance Figural Test of Creative Thinking was administered to 
freshmen in various fine and applied arts curricula with the hope of: (a) 
contributing to construct validity and (b) enhancing the predictability 
of grades in courses which presumably elicit creative behavior. Four 
creativity variables were correlated with grades and ACT scores. Of 68 
correlations computed, one was significant. Furthermore, the Torrance 
variables did not significantly augment the correlations between ACT 
Composite and grades. Scores on the Torrance variables did discrimi- 
nate among the students in the major curricula. Nevertheless, little 
support was found for the test's construct validity. 

Facilitative Effects of Practice upon Nonverbal Creativity 

WILLIAM E. ROWETON and HERBERT L. SPENCER, JR., Indiana 
State University 

Numerous studies of verbal creativity indicate that idea originality 
increases progressively as more ideas are produced. The present study 
tested the effects of practi ce upon nonverbal creativity. Thirty-two 
fifth grade children were administered Form A and/or Form B of 
Torrance's picture completion task for five consecutive days. Figural 
originality increased with practice only on certain task items and, 
overall, only on Form A. Results were traceable to differences inherent 
in the alternate forms of the test, peculiarities of task items, amount of 
practice, etc. Apparently, extended effort does not indiscriminately 
enhance figural originality in nonverbal creative problem solving. 

An Analysis of the Trend of Originality Scores on a Measure of 
Creativity 

IRENE S. SHIGAKI, New York University 

Verbal and Figural protocols for the Torrance Tests of Creative 
Thinking administered to children in the intermediate grades were 
examined to test the hypothesis that there would be an increase in 
original responses in the later sections of a sequence of responses. 
Answers on each subtest were divided into five equal parts maintaining 
the order of responses. Chi-square tests were employed yielding a 



significant value for the Verbal Form (x 2 = 31.68, df = 4, p = < .001), 
but not for the Figural Form. Original responses on the Verbal Form 
became progressively more frequent with each successive segment of 
responses. 

Investigation of the Creative Productivity of Groups 

STEVEN V. OWEN, JOSEPH S. RENZULLI, and CAROLYN CALLA- 
HAN, University of Connecticut 

The objectives of this study were to determine whether participa- 
tion in a group problem solving situation facilitated (1) creative 
production, and (2) attitudes toward creative production among 
youngsters from various socioeconomic levels. Subjects were 270 
fourth, fifth, and sixth grade students from schools serving low and 
middle SES populations. Criterion measures consisted of the Torrance 
Tests of Creative Thinking, and a set of attitudinal rating scales. Results 
of factorial ANOVA's suggested that group participation facilitates 
both creative production and attitudes among higher SES subjects. 
Implications for creativity training programs and reducing pressure 
toward group conformity are discussed. 

Personality and Cognitive Correlates of Creativity in Writers 

ARLENE RING BARRO, University of California, Los Angeles 

This study sought to determine whether personality or cognitive- 
factor tests are better able to distinguish between more creative and less 
creative writers. The subjects were 34 male graduate student writers 
whose performance as creative writers was rated by their professors. 
Each subject was tested with The California Psychological Inventory, 
the Study of Values, and Guilford's divergent production tests. Both 
simple and multiple correlation analyses support the view that 
personality characteristics, rather than cognitive abilities, hold the key 
to identifying creative potential in writers. A multiple regression 
equation relating rated creativity to personality test scores is presented. 



DEVELOPING TEACHER CHANGE AGENTS FOR DE- 
SEGREGATED SCHOOLS 

The Cadre Approach to Teacher Training: Developing Change Agents 
for Desegregated Schools 

JAMES L. DESLONDE, University of California, Riverside; 
ELIZABETH FLACH, Riverside Unified School District 

Students were released from traditional credential courses to 
become members of the staff of two desegregated elementary schools. 
The program attempted to train students as well as certified teachers to 
be more effective in desegregated classrooms. Evaluation data support 
the following conclusions: (a) the authors suggest a school change 
model to measure the degree of integration within a school building, (b) 
university and school district personnel encouraged a "modeling 
process" on the part of the student teachers; highest G.P.A.'s and 
M.T.A.I. scores were for students who viewed themselves as change 
agents; C.P.I. scores indicate change agent students have "non- 
traditiona!" profiles. 



EARLY CHILDHOOD EDUCATION 

A Two-Year Study of Intervention with Disadvantaged Infants 

RUSSELL A. DUSEWICZ, Pennsylvania Department of Education; 
MARTIN J. HIGGINS, West Chester State College 

A two-year study of an infant intervention program demonstrated 
remarkable results in working with over 100 disadvantaged children 
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from 16 to 40 months of age. Center Groups attending a centrally 
located cognitive enrichment program daily were compared with Home 
Groups receiving 80 minutes of tutoring in the home weekly. Center 
Groups were exposed to a program initially with a sensory emphasis 
aimed at building a firm foundation in perceptual-integrative skills and 
subsequently involving a higher-order cognitive activities emphasis. 
Analyses of covariance on a wide variety of measures overwhelmingly 
indicated significant differences in cognitive and language development 
favoring the Center Program. 

A Five-Year Longitudinal Comparison of a Traditional Versus Struc- 
tured Preschool Program on Cognitive, Social, and Affective Variables 

MERLE B. KARNES, R. REID 2EHRBACH, JAMES A. TESKA, 
University of Illinois, Urbana-Champaign 

Data pertinent to the longitudinal (5-year) effects of the Karnes' 
Preschool Program on four-year-old children relative to cognitive, 
social, and affective variables reveal differential effects associated with 
programming. Cognitively, the Karnes program had a strong initial 
positive effect on the intellectual functioning of children which even 
after five years was significantly above initial level. Academically, 
children in the Karnes program, after four years, were achieving at a 
significantly higher level. I n spite of dire predictions of negative effects 
of a structured program on the social and affective growth of children, 
these beliefs were refuted. 

A New Professional Role in Early Childhood Education 

R. REID ZE HR BACH, MERLE B. KARNES, JAMES A. TESKA, 
University of Illinois, Urbana-Champaign 

The traditional concept of education— one teacher in a classroom— is 
ineffective with children from low-income families. Six studies con- 
ducted at the University of Illinois, Urbana-Champaign Campus, 
provide the basis for a new role model in early education— the 
Paraprofessional Educator Manager (PEM). The model uses one 
professionally trained individual to direct the activities of two teams, 
each composed of three paraprofessional teachers and one para- 
professional home visitor, who use a structured approach for educating 
young children which involves both the classroom and home setting. 
Implications for recruiting and training individuals to implement the 
model are discussed. 

How Mothers Teach 

PATRICIA P. OLMSTED and R. EMILE JESTER, University of 
Florida 

The teaching styles of mothers were studied as a function of 
socioeconomic status. The results showed that: (1) low socioeconomic 
status mothers did not adequately introduce a learning task with 
advance organizers but high socioeconomic status mothers did; (2) low 
socioeconomic status mothers were less thorough in their presentation 
than were b;gh socioeconomic status mothers; (3) low socioeconomic 
status mothers provided less rationale for corrections in the task than 
did high socioeconomic status mothers; and (4) low socioeconomic 
status mothers used negative methods for control more frequently than 
high socioeconomic status mothers. The results are discussed with 
implications for the public school system. 

Self-Instruction by Four-Year-Old Children 

EVAN R. KEISLAR and JEAN PHINNEY, University of California, 
Los Angeles 

Four formative evaluation studies, involving 79 Headstart children, 
were conducted to develop a self-instructional game where each child 
could learn by using a picture book as an optional information source. 



For the initial paired-associate task of learning where animals live, a 
trial-and-error strategy, was inferior to self-prompting. Rewarding 
children for avoiding overuse of the book was less effective than 
rewarding any strategy indiscriminately. In a natural classroom setting, 
almost all children chose to play the game; one-third learned up tc a 
90% criterion. Observational data are presented; implications for 
developing better self-instructional skills are discussed. 



EARLY CHILDHOOD EDUCATION II 

The Effect of Informal and Formal British Infant Schools on Reading 
Achievement 

LAURA D. HARCKHAM, Manhattan College; DONALD V. ERGER, 
Herricks Public Schools 

British infant schools have attracted attention because of their 
child-centered programs. It was hypothesized that reading achievement 
would be significantly higher for children in these schools than for 
children in traditional schools. Three samples of British children were 
used— inner-city, suburban, and pairs of siblings, one of whom had 
learned by each method. Scores on the Holborn Reading Analysis Test 
were compared for subjects in informal and formal schools, and t-tests 
in three analyses showed no significant differences. Apparently advan- 
tages of the informal method do not lie in the area of greater immediate 
achievement, as measured by current instruments. 

Home Reading Instruction for Preschoolers with Systematic Reinforce- 
ment: A Longitudinal Experimental Analysis 

JAMES B. BREILING and ANNETTE BREILING, Institute for 
Behavioral Research 

Staats' preschool reading instruction with a single S operant design 
was replicated and extended. Social and token reinforcement in daily 
15-30 minute sessions conducted over an initial 2% months resulted in 
second grade reading by two 3-year-olds. Instruction was discontinued 
and reinstated several times over a four year period* Gains dropped 
when instruction was first discontinued but later became stable. S2 
made her gains despite a hearing handicap and speech retardation. IQs 
went from average at age 3 to off the Stanford Binet scale (170+) for 
SI at age 6-4. Social adjustment has been good for both Ss. The work is 
being extended with other parents. 

Helping Problem Learners During the Early Childhood Years 

DOREEN R. STEG and ANTHONY D'ANNUNZIO, Drexel University 

Study compares effects of early childhood instructional programs— 
designed to develop auditory and visual perception skills by stressing 
differential diagnosis, prescriptive suggestions and concomitant 
procedures— with programs typically found in nursery schools. Treat- 
ment group of twelve paired on intelligence, auditory and visual 
perception scores. Treatment group split in two, each receiving 
instruction engaging weaker sense modality, mainly visual for one, 
mainly auditory for the other. Statistical analysis revealed significantly 
higher scopes on both perceptual indices for the treatment groups. 
Study suggests need to focus upon modification of behaviors basic to 
learning (e.g., perception) and catering to the specificity of learner 
inadequacies. 

The Preschooler: Socioeconomic Status, Race, and Incidental Learning 

JANET D. SMITH, LAWRENCE W. LEZOTTE, and WILLIAM H. 
SCHMIDT, Michigan Stat?- University 

Incidental learning in forty-eight middle and lower class black and 
white preschool children was investigated to explore evidence of such 
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learning as it relates to social class, race, and familiarity of material. 
Two comparable groups were utilized in the customary directed 
instruction versus no-instruction situation. Subjects were obtained from 
two local day care centers. The area appears to hold significant 
implications for additional techniques which might be utilized in 
preschool instruction. A significant race by type of learning interaction 
was found. 

Auding Achievement of Kindergarten Pupils Related to Selected Pupil 
Characteristics 

MARY N. AYERS, University of South Carolina 

The purposes of this study are: (1) to identify the auding (listening 
comprehension) levels of achievement of kindergarten children and (2) 
to explore the extent of relationships between the child's auding 
achievement and selected pupil characteristics. Fifty-one five-year old 
children enrolled in kindergarten served as the subjects for this study. 
The auding instrument consists of four selections to be read indi- 
vidually to a child after which he is asked a series of questions to 
determine the extent to which he can understand what has been read to 
him. Findings indicated five-year olds can aurally understand materials 
as high as fifth grade reading level. 



THE EDUCATION OF DISADVANTAGED CHILDREN 

The Development and Evaluation of a Math Curriculum for Three Year 
Old Disadvantaged Preschool Children 

RUTH H. McCLURE, RUSSELL A. DUSEWICZ and ERNEST L. 
PETERS, West Chester State College 

The present study was undertaken to develop, utilize, and evaluate a 
beginning math program for disadvantaged preschoolers. Thirteen 
three-year-olds were randomly assigned to either of two programs: a 
group instruction program or an individualized instruction program. 
Thirty-three ten-minute lessons were given over a nine-week period. All 
children were pre- and posttested on a specially constructed math 
concepts achievement test. A correlated t-test on achievement gain 
indicated significant learning in both groups during training. An analysis 
of covariance on posttest scores across the two types of programs 
revealed significant achievement superiority for the individualized 
program. 

Effects of a Five-year Compensatory Education Program on Social, 
Intellectual, Linguistic, and Academic Development 

ROBERT L. SPAULDING, San Jose State College 

The effects of experimental programs developed for a small-scale 
school system enrolling approximately 300 disadvantaged children aged 
two through ten are presented. Intervention methods included behavior 
modification, directed teaching, discovery pedagogy, programmed 
instruction, team-teaching, cross-aged grouping, peer-tutoring, self- 
directed programming, dramatic-play techniques, and automated in- 
structional devices. Longitudinal data were gathered in socialization, 
intellectual development, language development, and academic achieve- 
ment. Significant differences favoring experimental groups were found 
for socialization and intellectual development. Non-significant differ- 
ences were found in most comparisons in language development and 
academic achievement. Results supported the value of early educational 
intervention in overcoming specific decrements in social and intellectual 
development. 

The Automated Instruction of Practical Reading Skills to Dis- 
advantaged Sixth Grade Children 

HAROLD R. STRANG, University of Virginia 



An assessment was made of the effects of an automated tutoring 
program iq teaching sixth grade disadvantaged children practical reading 
skills. After a 51 question pretest experimental students received 20 
sessions of automated instruction on 24 skills. Correct answering 
yielded extrinsic reinforcement; errors yielded audio tutoring. Students 
then received a 51 skill posttest. The experimental group's cross-test 
gs;r. more; than doubled that recorded by a control group. While 
experimental students showed greatest gains on skills trained during 
instruction, they also showed significant improvement on uninstructed 
skills. 

Improvement of Academic Performance of Poor-Prognosis Children 
Through the Use of an Individualized Instructional Program 

LAUREN B. RESNICK and MARGARET C. WANG, University of 
Pittsburgh 

This paper examines the effect of a year-long individualized 
mathematics program on the achievement of young children in an 
inner-city school. Achievement levels approximately six months ahead 
of grade level are found for children in the program while, children not 
in the program but in the same school, fall approximately six months 
behind grade level by the second grade. The relationship of traditional 
predictors of academic success (IQ and SES variables) is fo:,nd to 
diminish with use of the curriculum while the number of curriculum 
objectives actually mastered predicts standardized achievement test 
performance quite well. 

An Investigation of Attitudes among Potential Dropouts from Minority 
Groups during their Freshman Year in High School 

HERSHEL D. THORNBURG, The University of Arizona 

Forty-three high risk potential dropouts were selected to be in a 
special academic program consisting of English and mathematics in an 
attempt to (a) increase holding power, and (b) produce positive attitude 
shift toward self and school in a heavily impacted minority youth area 
of rural Arizona. After one year of evaluation more of these youth 
remained in school than comparable vocationally-placed and control 
youth. Attitudes toward school were more positive among this group as 
well (.01 level). Special academic students made a profound shift in 
self-concept (.001 level) as compared to the other two groups. All three 
findings attest to program effectiveness. 



EFFECT OF CLASSROOM ORGANIZATION ON TEACHER AND 
PUPIL BEHAVIOR 

Teachers' and Pupils' Roles in Variously Structured Classroom Settings 
and Subsettings: A Report from the Columbia Classroom Environments 
Project 

JOSEPH C. GRANNIS, SALLY W. KAMINSKY and WALTER M. 
FURMAN, Teachers College, Columbia University 

To examine a hypothesized association of the knowledge, social, 
and physical orders of learning environments, observations have been 
conducted in exemplar classrooms of four different primary grade 
instructional programs. The analysis reveals both the structural 
coherence of the programs internally and unintended or unsuspected 
regularities across programs. Teachers' norms for pupil behavior, setting 
prerequisites for knowledge transmission and social control, and pupils' 
development as learners, are hypothesized to explain the observed 
regularities and differences. The analysis is based upon classroom 
behavior stream observations, behavior setting observations, and video- 
tapes, as well as teacher questionnaire and interview data. 



EFFECTS OF MODELING ON COOPERATIVE BEHAVIOR 

Social Learning Theory and Group Behavioral Change 

DAVID TURNER, Illinois Benedictine College; BRUCE BALOW, U. S. 
Office of Education 

This study investigated whether collaborative and socially sensitive 
behaviors, necessary in group problem solving, can be taught to 
emotionally disturbed children in residential treatment centers. The 
instrument used was the Russel l Sage Social Relations Test, yielding 
scores on 10 variables. The sample consisted of 180 males ranging in age 
from nine through twelve years in residential centers. 

Analyses of posttest variables of the experimental group (exposed to 
a film modeling cooperative behaviors) and the control group (exposed 
to a "neutral" film) indicated that modeling of behaviors through a 
filmed technique can produce positive changes in the cooperative group 
behaviors of children identified as emotionally disturbed. 



EXPORTABLE USER TRAINING SYSTEMS 

Exportable User Training: A Developmental Strategy 

JOHN A. HYLTON, Southwest Regional Laboratory for Educational 
Research and Development; PAUL E. RESTA, University of New 
Mexico 

This document presents a model for the development of user 
training programs for validated instructional systems. Important 
considerations included within are identification of user categories, 
statement of user functions, selection of the training mode, and the 
iterative developmental cycle involved. Advantages and disadvantages of 
the proposed model are briefly discussed. 



FACILITATIVE EFFECTS OF INTERFERENCE ON RETENTION 
AND TRANSFER 

Interference During Learning as a Source of Facilitation in Subsequent 
Transfer and Retention 

WILLIAM F. BATTIG, University of Colorado 

Based on nine years of research in ours and other human-learning 
laboratories, a wealth of evidence is summarized and discussed which 
indicates that initial learning under conditions of high intratask 
interference leads to facilitated subsequent retention and transfer of the 
learned material. Since this runs directly counter to underlying 
principles and practices governing most present-day educational pro- 
cedures (such as programmed learning), the potential significance for 
educational research and practice of this inverse relationship (whereby 
increased difficulty of learning may result in better retention and 
transfer thereof) is also argued and discussed. 



FACTORS AFFECTING PUPIL COGNITIVE GROWTH IN 
DISADVANTAGED CHILDREN 

Analyses of Classroom Behavior and Pupil Growth in Project Follow 
Through 

ROBERT S. SOAR, MARJORIE RAGOSTA, and EARL BLEKKING, 
University of Florida; RUTH M. SOAR, Florida Educational and 
Research Development Council 

This phase of the national evaluation of Follow Through collected 
observation data on four instruments in 430 classrooms (K-2) over 
three years. These data were factor analyzed and used to describe 



classrooms. Measures of pupil cognitive growth were reduced to three 
factor scores representing different levels of complexity, and these 
factor scores were related to the classroom behavior measures. The 
results indicate: different styles of teaching were supportive of different 
kinds of pupil growth, but relationships were often nonlinear, and 
factors which discriminated between experimental approaches often did 
not relate to pupil growth, whereas more subtle factors did. 



FORMATIVE EVALUATION OF MULTIMEDIA SELF- 
INSTRUCTIONAL SYSTEMS 

Development and Validation of a Model for Formative Evaluation of 
Multi-Media Self-Instructional Learning Systems 

ALLAN J. ABEDOR, Michigan State University 

Existing models of formative evaluation are inadequate when 
dealing with complex multi-media instructional systems. A new model 
was developed, using a small group (N = 12) tryout and debriefing 
procedure as the main method of identifying instructional problems 
and developing appropriate revisions. The model was validated in three 
field experiments using a pre-post control group design. Two experi- 
ments showed statistically significant differences (p < .01) favoring the 
experimental (revised version) group on all four dependent measures 
(post test, gain score, attitude survey, and % achieving criterion). The 
third experiment showed a significant difference (p < .05) on the 
post test only. 



A GENERATIVE LINGUISTIC SYSTEM FOR INSTRUCTIONAL 
DESIGNERS 

Toward an Instructional Pattern Language 

RALPH E. GRUBB, Teachers College, Columbia University 

Instructional designers have found from sad experience that the 
design of instruction does not flow from taxonomies ol research 
findings. This problem is basic to all Linnaean systems since they are 
associative rather than generative. This paper proposes for the designer 
a linguistic system that permits him to generate from lexical elements 
an infinite number of instructional patterns. This public language will 
permit the designer to converse with his colleagues and enable design to 
improve cumulatively. Additionally, each design statement, however 
provisional, will serve as a research proposal. Comparisons will be made 
with an existing environmental pattern language for architecture. 



INCREASING UNDERGRADUATE VERBAL INTERACTION 

Strategies for Increasing Seif-Initiated Verbal Interaction 

SAMUEL SECURRO, JR. and RICHARD T. WALLS, West Virginia 
University 

The present experiment compared the effects of experimental 
treatments on verbal responsiveness of 120 undergraduates participating 
in small group discussions. The design crossed three verbal recording 
strategies (student recorded own responses, leader recorded responses 
with subject's knowledge, and leader recorded responses without 
subject's knowledge), four group leaders (one per treatment), and four 
repeated recording sessions. Results showed that responsiveness was 
differentially facilitated by the effects of recording, with student 
recording showing a greater frequency of responses, and by repeated 
sessions of the same type. The results are discussed in terms of utility of 
recording strategies for classroom practice and research. 




INDIVIDUALIZED INSTRUCTION 

Student Response to Self-Scoring Opportunities Provided by an 
Individualized Instructional Program 

HENRY J. OLES, Southwest Texas State University; JOHN O. 
BOLVIN, University of Pittsburgh 

Students in the University of Pittsburgh's Individually Prescribed 
Instruction Program are taught to self-score their own math work as a 
means of encouraging the development of the ability to be self- 
evaluative. A technique to evaluate the degree and form of student 
misuse of self-scoring was developed. Results showed that the majority 
of the third through fifth grade students misused the process but even 
for a given individual there was no consistent pattern to these misuses. 
Programs that encourage self-evaluation need to develop a means of 
reinforcing desirable behavior and detecting inappropriate behavior. 

Peer Tutoring as a Technique for Teaching the Unmotivated 

MADAN MOHAN, State University of New York, Fredonia 

The study investigated the effects of peer .tutoring on mathematics 
achievement, motivation level, attitude toward school and self-concept 
by comparing the gains of tutors (N = 16) and tutees (N = 16) for the 
above variables against their counterparts in the control group using 
multivariate analysis of covariance. The reactions to the program from 
teachers, parents, experimental subjects and other school personnel 
were also obtained. The evaluation clearly indicated that one-to-one 
tutorial interaction favorably affected each individual's "fabric of 
knowledge, attitude and self-concept" and the program was fully 
supported by consumers and practitioners of education. 

Individualization of Composition Instruction through the Use of 
Dictation Equipment and Transformational Sentence-Combining 

THOMAS P. McGUINESS, Pennsylvania Department of Education; 
WILLIAM H. HEINER, Bucknell University 

Two new aspects of English composition instruction were studied in 
a ten-week program involving four teachers and 104 grade 7 pupils 
randomly assigned to three treatment groups and a control group. 
Dictation equipment was used by teachers to individualize composition 
instruction and by pupils to construct written compositions from their 
spoken compositions. A program of transformational sentence- 
combining utilizing models of syntactic structures and a system of 
positive reinforcement of desired writing behaviors replaced traditional 
instruction in grammar and composition. Investigated were the effects 
of the two experimental variables upon pupils syntactic fluency and 
pupils' attitudes toward the study of composition. 

The Effects of Various Review Paradigms and Student Pacing on 
Performance in an Individualized Computer-Managed Undergraduate 
Course 

THOMAS G. DUNN, University of Toledo 

The purpose of this study was to determine: (a) whether reviews 
facilitate retention; (b) the relative effectiveness of two review formats; 
(c) the optimum placement of reviews; and (d) the effect of student 
pacing on performance. Undergraduates enrolled in a Health Education 
course served as subjects. The results indicated that reviews did not 
facilitate performance on several dependent measures and no format or 
placement analyses were statistically significant. With respect to pacing, 
consistent pacers performed significantly better than nonconsistent 
pacers on several dependent measures. Also, an amount of review by 
pacing interaction suggested that only the nonconsistent pacers may 
need reviews. 



A Time-Based Methodology for Assessment of Individual Performance 

ENRIQUE ALBA, University of Florida 

An experiment was conducted using a methodology that considers 
the duration of each component within a performance movement. A 
performance movement consists of 1) a stimulus situation, (e.g., 
question); 2) the interval between the termination of the stimulus and 
the initiation of the response; and 3) the response itself. Each of the 
three components is measured on a time scale and the results are 
represented in a cumulative graph. Incorrect responses are also 
recorded. The resulting measures are particularly sensitive to experi- 
mental manipulations. It is concluded that the methodology will aid in 
research efforts dealing with instructional materials development. 



INFORMATION PROCESSING 

The Effects of Training of Analysis upon the Responding Style of 
Impulsive Children 

MARNE B. ISAKSON, J. WILLIAM MOORE, Bucknell University 

Thirty-four second-grade boys identified as impulsive responders in 
terms of response time and errors were trained to use details to see if 
more reflective behavior would result. One cause of impulsivity 
postulated was underdeveloped analytic skills. Training involved three 
phases with response time being allowed to vary. Results showed Ss 
trained made fewer errors than control Ss (p < .005). No differences in 
response time were found. Results suggest that impulsives make more 
errors because of nonanalytic behavior rather than because of fast 
responding, that response time and errors are independent, and that 
nonanalytic behavior can be modified through training. 



The Feeling-of-Knowing: An Assessment of Factors Affecting Its 
Accuracy 

RICHARD L. ISAKSON and WILLIAM E. HAUCK, Bucknell Uni- 
versity 

The study assesses the feeling-of-k nowing (FOK) accuracy and 
contributes to the understanding of its role in information processing. 
Subjects learned paired-associates under two conditions: advanced 
organizers and no advanced organizers. Subjects were tested on learned 
and nonlearned pairs. The test involved recall and recognition, each 
accompanied by ratings of FOK strength. Results showed that FOK 
after recall was not accurate while FOK after recognition was accurate. 
Advanced organizers had no effect on FOK accuracy yet they 
facilitated recognition. The effects on FOK of two other factors were 
examined as was the relationships between recall and recognition times 
and FOK strength and accuracy. 

Personality Factors and Information Demand in Decision Making 

BEATRICE HARRIS, Yeshiva University 

The influence of category width, the need to achieve, fear of failure, 
utility of reward and payoff on information demand was studied, using 
168 male high school students. In general, when there was no reward or 
incentive, the motives fear of failure and the need to achieve were not 
elicited to differentiate subjects' strategies in decision making. Also, 
with no incentive an individual's intelligence was not employed to 
develop a strategy. When a monetary incentive was offered, the 
subject's value of money affected his behavior when making decisions, 
overriding motives such as the need to achieve ar.d fear of failure. 
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Organization, Comprehension, and Some Evidence "How" 

JOEL R. LEVIN, Wisconsin Research and Development Center for 
Cognitive Learning 

Fifty-four fourth graders, subsequently classified on the basis of 
reading ability, were given stories to study in either printed or pictorial 
form. Half of the subjects given the printed version received a visual 
imagery organizational strategy prior to studying the passage. As 
predicted, imagery organization facilitated comprehension of the story, 
with the strategy being differentially effective for two kinds of poor 
readers. Those with adequate vocabulary skills benefited more from 
imagery instructions than those with inadequate vocabulary skills. The 
implications of this interaction were discussed with regard to the design 
of future strategy-training experiments. 

Perceptual Coding as a Function of IQ, MA, and CA 

GNANAOLIVU AARON, Indiana State University 

The relationship between IQ, MA, CA, and Coding ability was 
investigated. Coding ability denotes transformations of input informa- 
tion into meaningful patterns. It was measured through a test which 
required Ss to reproduce visual patterns from memory. I Q and MA were 
Ss' performance on two group tests of intelligence. Ss were 48 boys 
from ninth, fifth, and first grades. It was found that MA was a better 
predictor of coding ability than IQ or CA. The high correlation 
coefficient obtained between MA and coding ability was inteipreted to 
reflect the importance of coding ability as a fundamental factor in 
cognitive processes. 



INTERACTION OF APTITUDE AND METHOD 

Individual Differences, Short-Term Memory and Paired-Associates 
Learning 

MARY L. HOAGLUND, American Institutes for Research; SANDRA 
PINE and GLENN E. SNELBECKER, Temple University 

The relationship between modality preference, presentation 
modality, type of task, and level of meaningfulness was investigated. 
Subjects were classified as auditory or visual learners on the basis of 
paired-associates tasks, and assigned to one of four balanced-order 
presentations of short-term memory tasks at two levels of meaningful- 
ness. Analysis of variance showed significant main effects for learning 
style and meaningfulness and interaction between order and meaning- 
fulness. Short-term memory tasks correlated significantly with each 
other and with measures of intelligence and achievement; paired- 
associates tasks correlated only with short-term memory visual tasks. 
No evidence was found for consistent modality preference in 
individuals. 

The Effect of Sequence and Familiarity with Subject Matter on 
Achievement from Programmed Instruction 

SIGMUND TOBIAS, Florida State University 

This study examined the effects of sequence in programmed 
instruction, the degree to which it was moderated by familiarity with 
content, and the interaction among sequence, ability and anxiety. A 
total of 117 Ss were randomly assigned to a logical or scrambled 
sequence on two linear programs. As expected, sequence exerted a 
strong main effect on unfamiliar content but not on subject matter 
with which Ss were previously acquainted. Sequence did interact with 
ability and anxiety on some dependent measures, though not to the 
degree previously expected. 



The Influence of Verbal Reinforcement and Socioeconomic Status on 
Task Persistence 

GLADYS H. MEANS, Cheyney State College; ROBERT S. MEANS, 
West Chester State College; JUDITH L. OSBORNE and BILLY F. 
ELSOM, Oklahoma State University 

A 2x3 ANOVA design and Duncan's technique. were utilized to 
assess the effect of verbal reinforcement and socioeconomic status on 
task persistence. Forty-five Middle and 45 Lower socioeconomic status 
fifth-grade Ss were randomly assigned to receive one of three 
treatments as they worked on an objectively difficult jigsaw puzzle. 
Treatment I Ss received positive reinforcement; Treatment II Ss 
negative reinforcement; and Treatment III Ss no verbal reinforcement. 
Middle socioeconomic Ss persisted significantly longer than Lower 
socioeconomic Ss (p < .10). Non-reinforced Ss persisted significantly 
longer than both positively (p < .05) and negatively reinforced Ss 
(pC.IO). 

The Self Concept of Students in Individually Prescribed Instruction 

KARIN R. MYERS, Indiana University 

This study assesses the self concepts of students in Individually 
Prescribed Instruction (IPI). Groups of third-, fifth- and sixth-grade IPI 
students in Ohio, Pennsylvania, and Illinois were administered the IPAT 
Children's Personality Questionnaire (The CPQ). There were no 
significant differences in the self concepts of the two age groups. 
Significant differences were found in the achievement levels, between 
the sexes, and in the number of years in the program. Further analyses 
indicated that the longer the students were in the IPI programs the 
lower their self concept became regardless of achievement level, sex, or 
age. _ 

The Generalizability of Aptitude-Treatment Interactions Across Subject 
Matter 

DAVID C. BERLINER, Far West Laboratory for Educational Research 
and Development 

Aptitude-treatment interactions which were obtained and replicated 
in previous studies were investigated using new subject matter. Lecture 
instruction was provided 154 Ss who took notes, paid attention, or had 
to respond to questions inserted into the lecture. Generalization of a 
significant interaction between note-taking and paying attention was 
established. Regression analyses using the Johnson-Neyman technique 
revealed that Ss high in memory ability perform significantly better on 
criterion tests when taking notes, while Ss low in memory ability who 
pay attention perform as well or better as those who take notes during 
lecture instruction. 



INSTRUCTIONAL METHODS 

Additive Effects of Advance Organizers 

MARTIN R. WONG, University of South Florida 

It was hypothesized that the effect of advance organizers on 
learning and retention was additive rather than interactive— i.e., that 
any increment in score could be accounted for by specific factors such 
as additional information, additional practice, learning set, etc. 123 
college undergraduates studied learning materials in four treatment 
groups. On five and 37-day retention measures the advance organizer- 
only group was significantly better than a no-treatment control and was 
the only group to not decline in score over the 32-day interval. The 
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advance organizer-plus learning group was significantly better than a 
learning-only group on the shorter retention period but not on the 
longer. 

Video-Taped Playback: A Viable Classroom Technique to Facilitate 
Student Learning 

DONALD M. RONCHI and RICHARD E. RIPPLE, Cornell University 

The study was Undertaken to determine the effectiveness of 
video-taped playback as a viable classroom technique to facilitate 
student learning. Small groups of students from fifth- and sixth-grade 
social studio classes were organized into three experimental conditions: 
(a) those who viewed playback of their own group, (b) those who 
viewed playback of another group, and (c) those who viewed no 
playback at all. Those groups who experienced video-taped playback of 
their own group displayed significant increases in performance and in 
positive attitudes toward problem-solving. These results are discussed in 
terms of the utility of video-taped playback in a social learning theory 
paradigm. 

The Use of a Structured Tutorial Reading Program in Teaching 
Nonreading Second Graders in Title I Schools to Read 

GRANT VON HARRISON, Brigham Young University; WAYNE 
NELSON, Nebo School District; LYLE TREGASKIS, Alpine School 
District 

This study was designed to test the potential of a structured tutorial 
reading program in teaching nonreading second graders how to read. 
Upper-grade (4th, 5th and 6th) elementary students were used as 
tutors. The student tutors were trained by teacher-aides in the use of 
specified tutorial procedures which were derived from established 
psychological principles of learning. The decoding ability of the 
experimental group was comparable with control group consisting of 
a random sample of the total population of second graders in three 
non-Title I schools on the posttest. 

Development and Research of Training Materials in Instructional 
Psychology 

EVA BAKER, University of California, Los Angeles; EDYS 
QUELLMALZ, Southwest Regional Laboratory for Educational 
Research and Development 

The development of a program to train educators to use five 
research-derived instructional techniques will be described. The results 
of over 12 tryouts, involving 200 subjects, will be reported by 
trial-to-trial performance improvements on information, discrimination 
and instructional design tasks. The developers conducted four experi- 
ments to aid instructional design decisions. Variables manipulated 
include the use of text-embedded questions, concept labeling, learner 
"set," and directions to produce criterion items. Significant differences 
were found in the concept labeling and criterion production experi- 
ments. Conclusions will focus on obtained performance levels, experi- 
mental results and operational recommendations to guide future 
development activities. 

The Effect of Manipulation of Class Size on Student Achievement 

WILLIAM B. MOODY and R. BARKER BAUSELL, University of 
Delaware; JOSEPH R. JENKINS, New Mexico State University 

Although considerable research has examined the relationship 
between class size and student achievement, these studies typically 
concentrate on the instruction of groups of 10 or more. In the present 
study 249 fourth grade Ss were randomly assigned to class sizes of 1, 2, 
5, and 23. Ss in each of the smaller class sizes displayed significantly 
greater attainment of ten specific mathematical objectives than did 



students in the classes containing 23 Ss. In addition, one-to-one 
instruction was significantly superior to each of the three larger 
instructional settings. 



LANGUAGE DEVELOPMENT AND ACQUISITION 

A Comparative Investigation of the Casual and Careful Oral Language 
Styles of Average and Superior Fifth Grade Boys and Girls 

JULIE M. JENSEN, University of Texas, Austin 

Is there a difference between average and superior fifth grade boys 
and girls in casual and coreful oral Janguage fluency, grammatical 
control, and function? The study aimed to provide a base for 
recommendations regarding aspects of language arts curricula for 
superior fifth grade pupils. Eighty subjects were selected through a 
two-stage sampling procedure from five Minneapolis, Minnesota public 
schools. One-hundred word samples of transcribed speech produced 
within two varying language contexts were 'analyzed, ultimately 
providing implications related to the formal teaching of grammar and 
usage, differential sex expectations, diagnostic skills for elementary 
teachers, and the relevance of the general term "gifted." 

Dialect Proficiency and Auditory Comprehension in Standard and 
Black Nonstandard English 

BETTY B. LEVY, Teachers College, Columbia University 

Thirty-two Black second graders were administered 1) a dialect 
proficiency task (oral repetition of 20 sentences); 2) an auditory 
comprehension task (taped oral stories and questions). Half of theSs 
received stories in Standard English; the other half received the stories 
' in Black Nonstandard English. Ss were asked to identify the race of the 
speakers and how well they liked the stories and speakers. Ss performed 
better in the Standard treatment. Within each treatment there was a 
positive relationship between dialect proficiency and auditory compre- 
hension. Ss correctly identified Black Nonstandard speakers but tended 
to misidentify Standard speakers. Stories were well-liked in both 
versions. 

The Effect of Mode of Presentation on the Linguistic Comprehension 
of Children from Different Ethnic Groups 

MARGARET M. BIERLY, Stanford University; JOAN P. BEAN, 
University of Massachusetts 

Ninety subjects, 45 kindergarten and 45 first graders participated in 
a study of linguistic comprehension. Three ethnic groups were 
represented Anglo-American, Black-American and Mexican-American. 
Twenty-eight sentences including active and passive constructions, 
direct and indirect object constructions and conjoined constructions, 
were presented in pictorial, puppet and enactive conditions. The 
prediction was that performance would be poorest on pictorial items, 
better in "acting out" sentences and best when the 5 became the string 
"actor". This prediction held for Anglo-American kindergarten 5s only. 
There were no overall ethnic group differences; and no treatment 
effects at kindergarten or first grade. 

The Relationship between Age and Accuracy of Foreign Language 
Pronunciation 

S. JAY SAMUELS and LINDA L. OLSON, University of Minnesota 

The assumption that younger children master the phonological 
system of a second language more easily than those who are older was 
tested. Randomly selected groups of 20 elementary, 20 junior high, and 
20 college students received 1C lessons of taped German phoneme 
pronunciation instruction. Phonemes were taught using mimicry drills. 
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Students were pre-tested, post-tested and given the Raven Intelligence 
test. ANOVA and ANCOVA on the pre-test indicated no difference 
among the groups in pronunciation. Contrary to prediction, the 
ANOVA and ANCOVA on the post-test indicated junior high and 
college students were significantly superior at pronunciation than the 
elementary group. 

Associative Reaction Time in Language Acquisition 

RONALD LEY, State University of New York, Albany; DAVID 
LOCASCIO, Fairleigh Dickinson University 

The results of a systematic program of research conducted over the 
past several years have established that the associative reaction time of 
verbal units is an important variable in language acquisition. The 
findings of this research have led to the development of a new 
theoretical interpretation of verbal acquisition in which meaningful ness 
is posited as an index of the stability of a perceptual encoding process 
and associative reaction time is posited as an index of recallability. The 
research findings and the evolving theory hold considerable promise for 
new directions in research in language acquisition. 



LEARNING STRATEGIES 

The Effects of Selected Experiences on the Ability of Disadvantaged 
Kindergarten and First Grade Children to Use Properties of Equivalence 
and Order Relations 

DOUGLAS T. OWENS, University of British Columbia 

Instruction was given to economically-disadvantaged kindergarten 
and first grade children on matching relations, length relations, 
conservation and the transitive property of matching relations. A 
control group received only the instruction on relations. Univariate 
analyses showed significance (p < .01) due to treatment for Transitivity 
of Matching Relations. Grade was significant for Matching Relations, 
Conservation of Matching Relations (p < .01), Symmetric Property of 
Matching Relations, Asymmetric Property of Matching Relations and 
Reversibility of Matching Relations (p<.05), but neither Treatment 
nor Grade was significant for the six corresponding length relational 
variables. Performance on a Transitivity Problem was related to Grade 
but not to treatment. 

Acquiring a Mathematical Structure by Discovery and Rule Learning 

DENNIS E. EGAN and JAMES G. GREENO, University of Michigan 

The study concerned: (1) identifying component processes of 
discovery and rule learning; (2) describing differences in learning 
outcomes produced by the two methods; and (3) optimizing learning. 
In two experiments subjects acquired concepts of probability by 
discovery or rule versions of programmed instruction. Descriptions of 
learning by discovery and rule were based on reliable aptitude- 
treatment interactions involving several problem solving skills. The 
outcome of discovery seems to be the structural integration of 
previously known concepts, while the outcome of rule learning is the 
addition of new structure. Finally, subjectr scoring low on tests of 
relevant abilities performed better when instructed by the rule method. 

The Relationship of Success in a Short Term Memory Task to Subjects' 
Self-Reports of Information Processing Procedures 

WILLIAM C. LOW, RICHARD C. BOUTWELL and HARVEY B. 
BLACK, Brigham Young University 

The purpose of this study was to determine if 5s have rehearsal 
strategies available for reporting that are correlated with success in a 
short term memory task. College students were interviewed as to what 



strategy they had used in a short term memory task and it was found 
that success was highly correlated with reports of rehearsal strategies. It 
is argued that advantage can be taken of this experimental approach for 
the investigation of diagnostic and instructional techniques in short 
term memory tasks. 

Dydactic Validity of Learner Reports of Information Processing 
Strategies by Fourth Graders Learning Map Identification 

HARVEY B. BLACK, Brigham Young University 

Two related studies employing 10-year-old children learning to label 
map-like figures were used to investigate the feasibility of employing 
learner reports of information processing strategies employed during 
learning. Self report protocols were collected and analyzed and 
indicated that consistent with the Greeno (1970) model of paired- 
associate learning, reported discriminability of the stimulus term and 
the reported degree of integrative coding of both the stimulus and 
response terms were related to learner efficiency. In the second 
experiment verbal instructions were highly effective in establishing the 
most effective strategies uniformly among learners regardless of other 
individual differences. 

introspective Reports as a Function of Anxiety Level and Task 
Difficulty in Concept Acquisition 

RICHARD C. BOUTWELL and HARVEY B. BLACK, Brigham Young 
University 

The effects of self ratings of accuracy of response in non-feedback 
learning and anxiety level were investigated. Using a complex concept 
task involving the identification of RX 2 crystals following an illustrated 
definition of negative and positive instances, it was found that while 
low anxiety 5s tended to consistently over estimate performance, they 
correctly estimated higher performance on easier tasks as compared to 
harder tasks. However, high anxiety 5s were much more conservative in 
estimating performance, particularly on the easy task. The predictive 
validity of performance was found to be a function of both anxiety 
level and task difficulty. 



MATHEMATICAL LEARNING I 

The Relative Effectiveness of Two Different Instructional Sequences 
Designed to Teach the Addition and Subtraction Algorithms 

CLYDE A. WILES, THOMAS A. ROMBERG and JAMES M. MOSER, 
University of Wisconsin 

Two sequences of activities were developed to provide instruction 
on the algorithms for addition and subtraction of two-digit numbers. In 
the integrated sequence (I) the mechanics of "carrying" and "borrow- 
ing" were treated as a single process "regrouping." In the sequential 
treatment (S) the addition algorithm was developed before the 
subtraction algorithm. Students of two second-grade classes were 
randomly reassigned to either group S or Group I. Profiles were 
generated by item sampling. Group means were estimated fer addition, 
subtraction and total performance every three days. Also, on the 
eighteenth day all children were administered a 20 item test. 

All comparisons favored group S. 

Interaction Effects Between Selected Cognitive Abilities and Instruc- 
tional Treatment in Algebra: An ATI Study 

LELAND F. WEBB, California State College, Bakersfield 

An experiment was conducted to determine the existence of an 
Aptitude Treatment Interaction (ATI) involving spatial visualization 
and general reasoning and two programmed instruction treatments in 
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quadratic inequalities emphasizing either spatial or symbolic reasoning. 
Using regression techniques, both treatments were equally effective. 
However, no evidence was presented to support the ATI hypothesis for 
either criterion (transfer test, time to criterion). As this study was a 
refinement of a study conducted by Carry (1967), comparisons of 
results between the studies were made. In general, the results of the two 
studies are not compatible, indicating that caution in generalizing 
results is necessary. 

Spatial and Modality Effects in Simple Mathematical Computation 

JOHN DEICHMANN and IAN D. BEATTIE, Southern Illinois Uni- 
versity 

This study explored the effects of visual (vertical and horizontal) 
and oral presentation modes upon simple mathematical computations 
(addition, subtraction, and multiplication). Seventy-two undergraduate 
education majors were employed as subjects. The placement of the 
process sign (left, middle, right) and whether a one or two digit number 
appeared first in the mathematical sentence was manipulated. The 
results demonstrated significant differences for modality, type of 
computation, sign and two-digit placement. Further, it appears that for 
the oral presentation, the process sign placed last is superior to the first 
position. 

An Investigation of the Variables of Bloom's Mastery Learning Model 
for Teaching Mathematics 

KENNETH COLLINS and GRAYSON H. WHEATLEY, Purdue 
University 

The study investigated Bloom's mastery learning model for teaching 
secondary school mathematics. It utilized three variables: specification 
of objectives, diagnostic-progress (d-p) tests, and alternate resources for 
learning. Classes using either the objectives or d-p tests did significantly 
better on the posttest than a control class using none of the variables. 
Classes using objectives and d-p tests with alternate resources also 
performed significantly better than a control class. Thus a mastery 
learning model can significantly increase student achievement. The 
combined use of objectives, d-p tests, and alternate resources can 
further increase student mastery. 

Error Trends in Solving Number Sentences Relating to Workbook 
Format Across First and Second Grades 

IAN BEATTIE and JOHN DEICHMANN, Southern Illinois University 

The effects of presentation, place holder and illustration upon one 
year's work of 132 first and second grade children in solving number 
sentences was measured by rate and type of error produced. An 
attempt was made to identify error trends over operation and grades 
relative to presentations methods. Results appear to demonstrate that 
presentation (vertical or horizontal), place holder (left, middle, right) 
and whether illustration are present or not, do have differential effects 
both on error rate, type, and that these effects are not constant across 
grade levels. 



MATHEMATICAL LEARNING II 

The Child's Introduction to Mathematics: A Transfer Model Based in 
Measurement 

R. KEITH VAN WAGENEN AND RONALD D. 2ELLNER, Arizona 
State University 

Mathematics learning was introduced to kindergarten children by 
operations of linear measurement. Arbitrary units of measure were used 
to teach the child "unit of measure" as a power, addition and 



subtraction by the rule n±1, and conservation of quantity. All 
instructional exercises were based in measurement and this common 
context for various concepts was intended to provide a transfer base for 
successive new concepts. Both an arithmetic concepts test of 61 items 
and the Concept Assessment Kit— Conservation, administered on 
entering and leaving, gave evidence of significant gains in the treated 
sample but not in a control sample. 

Inductive and Deductive Learning Styles in Mathematics 

JANE DONNELLY GAWRONSKI, University of Minnesota 

Programmed materials were developed to determine if eighth grade 
subjects exhibited inductive and deductive learning styles in mathe- 
matics. Subjects above the median on the posttest following a concept 
taught inductively and below the median on the posttest following a 
concept taught deductively were classified as Inductive Learners. 
Subjects above the median on the posttest following a concept taught 
deductively and below the median on the posttest following a concept 
taught inductively were classified as Deductive Learners. 32 Deductive 
and 22 Inductive Learners were identified and administered an 
Inductive program and a Deductive program. No significant differ- 
ences were detected on the posttests. 

Role-Play and Characterization as Techniques for Teaching Primary 
Level Number Concepts 

BERNADETTE M. ANTKOVIAK, Harrisburg Area Community 
College; HUGH F. McKEEGAN, Bucknell University 

The object of this study was to assess how two variables in 
children's play, characterization and role-playing, affect learning per- 
formance in a cognitively oriented task— the learning of basic number 
combinations. Subjects were 40 kindergarten children randomly 
assigned to one of four treatments. The treatments involved role- 
playing and non-role-playing with either personification (characteriza- 
tion) of the number combinations as concepts or common animals. For 
immediate acquisition a significant interaction (p < .05) between 
role-play and form of concept was found. Retention results showed a 
significant treatment effect (p < .05). An explanation of the findings 
based on information theory is offered. 

Discovery Learning versus Expository Learning: New Insight into an 
Old Controversy 

BARBARA NELSON and DOROTHY FRAYER, Wisconsin Research 
and Development Center for Cognitive Learning 

Four geometry concepts were presented to 228 seventh grade Ss 
through lessons written in either a discovery mode or an expository 
mode. Ss studied the lessons independently on four consecutive days. 
One-third of the Ss received a test immediately after completion of the 
lessons, one-third 1 day after and one-third 21 days after. The 
expository group showea superior immediate acquisition. There was no 
difference between groups on retention. Expository Ss required only 
30% as much time to complete lessons as discovery Ss. Thus, the results 
of this study suggest that the expository method is more efficient. 

Verbalizing Method Influence on Short-Term Retention of Discovered 
Generalizations 

LARRY SOWDER, Northern Illinois University 

Do the short-term retention effects of five methods of verbalizing 
discovered generalizations differ? Fifty college subjects individually 
discovered generalizations (as judged by consecutive correct responses) 
of six sorting or numerical tasks. Verbalization occurred after each 
discovery. After ten minute* a retention test of items amenable to the 
generalizations was administered. ANOVAs o^ test scores indicated no 
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significant differences for the effects of the five methods, of modes of 
verbalizing {oral, written), or of sources of verbalizing (subject, external 
source). 



MATHEMATICAL LEARNING III 

The Effects of Selected Experiences on the Ability of EMR Children to 
Conserve and Use the Transitive Property of Three Matching Relations: 
A Feasibility Study 

THOMAS J. COONEY, University of Georgia; DOUGLAS T. OWENS, 
University of British Columbia 

^ The purpose of this study was to investigate the effects of training 
12 EMR children ranging in age from (12; 8) to (15; 6) to conserve and 
use the transitive property on the relations same number as, more than 
and fewer than. Tests and instructional materials were designed. The 
binomial test indicated a significant increase in the number of students 
who could conserve and use transitivity from pretest to posttest 
(p < .01, p < .02) and from pretest to retention test (p < .01, p < .04). 
Evidence is provided that helps characterize the cognitive development 
of older EMR children and suggests possible curriculum materials that 
may be meaningfully utilized. 

An Investigation in the Learning of Selected Parts of a Boolean Algebra 
by Five and Six-Year-Old Children 

DAVID C. JOHNSON, University of Northern Michigan 

A treatment on classification and relations was administered to 
forty five- and six-year-old children with forty children serving as 
controls. Direct achievement tests and transfer tests were administered 
after treatment. The transfer tests included measures on transitivity of 
the relations, class inclusion, and matrix items. The achievement tests 
consisted of measures on connectives, relational terminology, and 
intersecting rings. IQ and age were classificational variables. Effects due 
to treatment and IQ only were significant (p < .01) for transfer and 
achievement measures. Results of univariate ANOVA's showed no 
treatment effect for the class inclusion subtest. 

Student-Generated, Textbook, and Pictorial Presentations of Mathe- 
matical Problems 

GERALD KULM, JOAN LEWIS, ISSA OMARI and HAROLD COOK, 
Teachers College, Columbia University 

Ten mathematical problems were presented to 116 ninth graders in 
one of five treatment versions: Student, Textbook, Pictorial, Student 
with Picture, and Textbook with Picture. Treatment by IQanalysesof 
variance produced statistically significant interactions between treat- 
ment and IQ only for the easiest problems when correct method and 
presence of a sketch were the criteria. The Pictorial version was superior 
for medium and high IQ groups when the criterion was presence of a 
sketch; the Student and Textbook versions were superior for the low IG 
group on easy problems when the criterion was the correct method. 

An Investigation in the Learning of Relational Properties by Kinder- 
garten Children 

LESLIE P. STEFFE and RUSSELL L. CAREY, University of Georgia 

A sample of 48 kindergarten children were partitioned into two 
treatment groups where each treatment was designed using two 
relational categories; matching relations and length relations. Treatment 
was not significant (sign test) on tests of conservation of length 
relations, conservation of matching relations, transitivity, and asym- 
metry. The McNemar test of significance of changes was significant 
(? < .01) for the 48 children in the case of conservation of matching 



relations, conservation of length relation, and transitivity. No evidence 
was present indicating that conservation of length relations precedes 
conservation of matching relations. 

Conservation and Achievement-Test Performance Among Fifth-Graders 

VIRGINIA M. SILLIPHANT and DAVID L. COX, Rutgers University 

The relationship between conservation and achievement was investi- 
gated by testing forty-eight fifth-graders on Piaget tasks of conservation 
and Stanford Achievement Tests of Word Meaning and Arithmetic 
Concepts. Thirty-five were classified as clearly concrete or formal. In 
comparison to those on the concrete level, those on the formal level of 
thought: (1) earned higher total scores on both tests (STAT); (2) 
answered specific items differently; (3) chose fewer wrong alternatives; 
and (4) *were not significantly different in intelligence and sex. 
Development of achievement-test scoring keys, instruction and cur- 
ricula within level of thought is suggested to maximize performance. 



MICRO-TEACHING 

Modification af the Frequency of Student-Initiated Higher-Order 
Questions through Microteaching and a Token Economy 

MYRA J. SADKER, University of Massachusetts 

The purpose of this investigation was to develop student skill in 
higher-order questioning (evaluation, comparison, cause and effect, 
problem-solving, and divergent questions). Four students were trained 
in higher-order questioning through an adapted microteaching proce- 
dure. After microteaching training, a token economy was established in 
the subjects' social studies class. Points were used to reinforce 
higher-order questions, and these points were exchangeable for various 
toys and games. The results indicate that elementary students can be 
taught to ask higher-order questions through microteaching and that 
this skill can be maintained through instatement of a token economy. 

The Use of Microteaching Techniques to Train Student-Teachers in 
Stimulating Learners' Questions 

LYA KREMER, Haifa, Israel; ARYE PERLBERG, Technion, Israel 
I nstitute of Technology 

This paper deals with the use of microteaching techniques to train 
student-teachers in stimulating learners' questions. Research was carried 
out at the Gordon Teachers Training College, Haifa, Israel. A rating 
scale, including teaching patterns stimulating learners' questions, was 
prepared from the existing literature and the analysis of pilot 
micro- lessons. Twenty student-teachers taught four micro-lessons each 
to seventh grade pupils, ten of them were supervised as a group, the 
others individually. The results show that microteaching helped 
student-teachers acquire behavior stimulating learners' questions, and 
that group supervision was most effective to this end. 

Effect of Supervisory Mode and Teacher Anxiety on Teacher Per- 
formance During Microteaching 

WILLIAM D. JOHNSON, University of Illinois, Urbana-Champaign; 
SALLY F. PANCRA2I0, Illinois State University 

Examination of a microteaching training effect in terms of teacher 
anxiety where the treatment is a supervisory conference was made for 
52 social studies student teachers. Supervision mode was classified as 
indirect or direct using a modified Flanders I A. Teacher anxiety was 
assessed by the Davis Anxiety Scale; Ss were classified as either high or 
low anxious. Criterion assessing teacher performance was Factor B, 
Teacher Performance Appraisal Scale. Data were analyzed using 
ANOVA. The results indicated a main effect significance, at .01 level. 
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for anxiety. The more highly anxious teacher had significantly better 
performance on the criterion. No supervisory effect was reported 
favoring a direct or indirect mode. 

Feedback Condition and Type of Teaching Skill in Micro-Teaching 

SUZANNE L. HISCOX and ADRIAN P. VAN MONDFRANS, Brigham 
Young University 

Audio tape (AT) and audio-video tape (VT) feedback were 
compared in teaching verbal and a combination of verbal and 
non-verbal skills in microteaching. Subjects were undergraduate educa- 
tional psychology students. They participated in two microteaching 
cycles of teach— feedback— reteach. Feedback consisted of a supervisor 
conference based on student ratings and either an AT or VT playback 
of the lesson. Analyses of covariance on student ratings of the teach 
and reteach sessions showed significant differences in favor of audio 
tape for verbal skills and no significant differences for combination 
skills. It appears audio tape is as effective as video tape in micro- 
teaching. 

Stability of Behavioral Change— One Year after Precision Micro- 
Teaching 

MARJORIE A. BOECK, Duke University 

The study was designed to determine whether students whose 
classroom behavior changed by applying "precision teaching" strategies 
in micro-teaching maintained these behaviors during student teaching. 
College juniors taught to categorize and graph their own questioning 
behavior as "low-level" and "high-level" showed marked increases in 
rates of high level questioning and pupil talk. Rates of teacher talk 
decreased. Audiotapes made during student teaching indicated that 
experimental subjects had maintained or increased their rate of 
high-level questioning. Rates of pupil and teacher talk were also 
maintained at post-treatment levels. Control subjects showed no change 
from baseline performance. 



MINICOURSE EVALUATION 

The Minicourse as a Method for Training Teachers to Stimulate 
Divergent Thinking 

EDWENNA R. WERNER, GLORIA Y. GOLDEN and STEPHEN R. 
MILLS, Far West Laboratory for Educational Research and Develop- 
ment 

Research objectives were to evaluate the effectiveness of Minicourse 
20: Divergent Thinking in training inservice teachers in grades 1 
through 12 to use brainstorming and other techniques to stimulate 
divergent thinking in students and to teach students to evaluate 
responses using criteria. The relative effectiveness of audio and video 
feedback in microteaching was compared. The TTCT and analysis of 
brainstorming responses were used to determine whether the students 
increased in fluency, flexibility, and originality. Results indicate that 
teachers acquire many of the course skills with either audio or video 
feedback. Analysis of student results will be reported. 

Evaluation of Minicourse 14, "A Discussion Approach to Controversial 
Issues" 

MORRIS K, LAI, MEREDITH D. GALL, RACHEL ANN ELDER and 
RITA WEATHERSBY, Far West Laboratory for Educational Research 
and Development 

A field test was conducted to evaluate Minicourse 14, "A Discussion 
Approach to Controversial Issues", an auto-instructional package for 
both teachers and students, developed by the Far West Laboratory for 



Educational Research and Development. Discussions 25 minutes in 
length were tape-recorded in 64 classes. Both teachers and students who 
took the course improved in their use of discussion techniques as 
compared with a control group. Student interaction doubled for the 
treatment group. All teachers who took the course indicated that it 
wouid be a worthwhile contribution to the current curriculum. 

Effectiveness of a Minicourse on Teaching Decoding Skills in Reading 

DAWN SKA5LAND, Far West Laboratory for Educational Research 
and Development 

Data are reported from the Main Field Test of a Minicourse on 
teaching reading (decoding) skills. Purposes of the test were to measure 
teacher behavioral changes and effects of reteach treatments. Com- 
parison of pre- and post-course videotaped lessons revealed a shift 
toward research -based teaching strategies presented in the course. A 
similar shift away from negative behaviors was also reported. Two- 
thirds of the teachers comparing the course with other inservice courses 
rated it better than others; the other third felt it was on a par with 
others. Results show the course to be effective in improving reading 
(decoding) instructional methods. 

Effects of Minicourse 2 on Teacher Skill in Developing Oral Language 
of Farm Migrant Children 

BEATRICE A. WARD, Far West Laboratory for Educational Research 
and Development 

Objectives were to identify which of four language development 
teaching behaviors were used by teachers and to evaluate effects of 
training in use of behaviors on teachers and pupils. Training included 
viewing models and microteaching. A sub-group also conducted daily 
20-minute in-class lessons. At end of training, trained teachers differed 
significantly from control teachers in three of four skills. Pupils in 
daily-lesson group differed significantly in gains in use of descriptive 
and action words. Results indicate course is effective for teachers and 
pupils. Daily in-class application of skills increases both teacher and 
pupil performance. 

Comparison of Instructional Media in a Minicourse on Higher Cognitive 
Questioning 

MEREDITH D. GALL, BARBARA DUNNING and HENRY BANKS, 
Far West Laboratory for Educational Research and Development; 
JOHN GALASSI, West Virginia University 

Research objectives were to evaluate a training program on higher 
cognitive questioning and to compare the effectiveness of two 
instructional media. Teachers in the video treatment viewed instruc- 
tional videotapes, read a handbook, and did microteaching. The 
handbook treatment was identical, except that teachers read transcripts 
of the videotapes. The two treatment groups made significantly greater 
gains than control teachers in use of higher cognitive Questions and 
elicitation of long student answers. Ninety percent of the teachers rated 
the course favorably. Results indicate the course is effective and that 
written materials are as effective as videotape presentation for training 
certain skills. 

MOTIVATION 

Development of a Motivational Needs Inventory 

JANICE SMITH, Broward County Schools 

The specific purpose of this study was to develop an instrument, the 
Motivational Needs Inventory (MNI), to identify students as achieve- 
ment or affiliation motivated in order to improve school performance 
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by providing verbal reinforcement appropriate to students' motive 
patterns. Factor analysis of ten teachers' ratings of a heterogeneous 
sample of 195 junior high students on the MNI yielded a five factor 
oblique solution of one achievement factor and four affiliation factors 
with high factor loadings for most items. Correlations of sub-scales of 
the two motivation dimensions with reading achievement confirmed the 
hypothesized relationship of achievement motivation and school 
success. 

Praise and Group Competition as Incentives 

KATHLEEN SENIOR and JERE E. BROPHY, University of Texas, 
Austin 

The relative effectiveness of praise and group competition as 
motivating incentives affecting task persistence in young children was 
investigated. As predicted, competition was relatively more effective 
with second-graders than with kindergarten children, with boys than 
with girls, and with dull tasks than with interesting tasks. However, 
competition was generally less effective than praise, across all condi- 
tions. Competition may not be a very effective incentive for younger 
school children, in view of its possible negative side effects. Praise 
appears to be simpler and more effective. 

Use of Access to a Recreation Activity Room to Motivate. Academic 
Behavior in a Junior High Public School Classroom 

DARREL E. BOSTOW and PHILIP R. RUNNELS, University of South 
Florida 

Twenty-four culturally deprived junior high students in an inner-city 
public school served as subjects. An ABAB experimental design was 
used to evaluate whether achievement of daily science and mathematics 
behavioral objectives as well as on-task classroom behaviors couid be 
increased by allowing the students to earn their way into a supervised 
activity room, contingent upon academic production. Results showed 
increased achievement of behavioral objectives by the class as a group 
when the reinforcement room v^as available. A time-sampling observa- 
tion technique revealed that percent of time spent on-task also 
increased when the activity room was in operation. 

High and Low Norms as Goals for Achievement 

DEIRDRE HIATT and MARGARET M. CLIFFORD, University of 
Iowa 

This study, conducted with 279 fifth graders, examined the effects 
of high norms (HN) and low norms (LN) used as goals in a vocabulary 
learning task. 5s in the LN condition had significantly higher retention 
scores; performance and interest were not significantly different. Ss 
whose ability level was closest to the norm given to their class 
performed better and expressed greater interest than 5s of comparable 
ability whose class was given a norm inappropriate to their ability level. 
Correlations between IQ, performance, and interest were higher in the 
HN condition. 

Selected Community, School, Teacher, and Personal Factors Associated 
with Girls Electing to Take Advanced Academic Mathematics Courses 
in High School 

ELIZABETH W. HAVEN, Educational Testing Service 

This study explores ways to motivate girls who do well in 
mathematics to elect high school advanced mathematics courses. Data 
were collected on 40 variables from 1,840 girls and 63 mathematics 
supervisors in New Jersey public high schools, grouped according to the 
proportion of college going girls taking advanced mathematics. The girls 
were grouped on whether they took these courses, with a special 
category expecting to major in mathematically-related fields. Two 



discriminant functions accounted for most of the variance: rating of 
future usefulness of high school mathematics and interest in natural 
science as opposed to social studies. 



OBSERVING CLASSROOM BEHAVIOR I 

The Use of the Technion Diagnostic System (T.D.S.) and Microteaching 
Techniques in Modifying Teacher Behavior 

ARYE PERLBERG, MIRIAM BAR-YAM, ARYE LEVEY, EHUD 
BAR-ON, RACHEL LEVIN, DALIA PINKAS, ARYE ETROG, JAEL 
NOAM, SHLOMO INBAR and CHAIM STAROBINETZ, Technion, 
Israel Institute of Technology 

Sixty science and engineering student-teachers taught, over twD 
semesters, eight micro lessons each. These were videotaped and 
analyzed by independent raters, according to a diagnostic instrument, 
T.D.S., for analyzing microteaching lessons. The instrument was derived 
from a mapping sentence of the instructional process, based on 
Guttman's facet theory. The supervision of students was geared to a 
"diagnostic" card obtained by means of computer analysis of video 
tapes. The treatment was effective in modifying behavior from 
teacher-centered, imparting knowledge and verbal activities, to pupil- 
centered, analytic thinking and nonverbal activities. 

Sociometric Effects on Small Classroom Groups using Curricula 
Identified as Process-Oriented 

RUTH S. NICKSE and RICHARD E. RIPPLE, Cornell University 

'Small classroom work groups from fifth and sixth grades par- 
ticipated in a three-week, student-directed, process-oriented social 
studies curricula. Sociometric measures were used to rank students in 
the classroom before and after the intensive collaboration among 
students. Attention was focused on the interaction between high and 
low socially accepted students as determined by their total sociometric 
scores. Significant differences were found that indicate a desegregation 
of rank effects within the classroom following small group work. 
Sociometric effects on the quality and amount of task-directed 
behavior and attitudes are also discussed as they affect classroom 
climate and cohesiveness. 



Self Confrontation Counseling of Prospective Teachers: A Review of 
the Literature and Some Prescriptions 

HARRY P. BAKER and FRANCES F. FULLER, Research and 
Development Center for Teacher Education, University of Texas at 
Austin 

Is behavior change achieved by procedures different from those 
commonly used when teachers see video tapes of their teaching? 
Convergences suggest the use of unambiguous, credible feedback which 
is overtly and covertly accepted by the teacher; video taping of good 
performances rather than weak ones; selection of strong teachers with 
concerns related to the specific performance; discrepancies between 
expectations and performance which are moderate rather than small or 
large; and the required presence of a non-evaluative counselor in a 
permissive situation focusing on behaviors which are remedial rather 
than those which are resistant to change. 
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The Effect upon Verbal Interaction Data of the Medium Employed in 
the Codification Process 

JOHN V. LONG, University of Rhode Island 

This study examined: 1) The effect of differing modes of data 
collection and quantification (Live observation, audiotape, videotape, 
typescript) upon verbal interaction data; 2) If a media effect did exist 
whether the effect was more pronounced with a complex us. a simple 
system. The Flanders 10 and 22 category systems were used to observe 
sixteen teachers from two elementary schools. Data generated under 
the four medium forms were analyzed using 4x4 Latin square repeated 
measures ANOVA. Results indicated that for specif ic verbal behaviors 
the medium employed in quantification did exert significant (p < .025) 
influence upon data obtained. Complexity hypotheses were not 
supported. 

A Multi-Variate Analysis of Non-Verbal Interaction Between Teachers 
and Students: The Measurement of Meaning of Visuo-Gestural Channel 
Expressions 

JOSEPH GERALD TERESA, University of Michigan; JOHN BRUCE 
FRANCIS, State University of New York, Buffalo 

The present study sought to determine whether in an educational 
setting, teachers and students could identify visuo-gestural expressions 
by assigning affective meaning to individual emotional expressionsu The 
analysis indicates that: 1) Three response clusters became' apparent. 2) 
Teachers' mean scores were higher than those of the students, 
interpreting the overall meaning for each emotional expression. 3) The 
independent variables of sex and IQ, when analyzed in a multi-variate 
manner, failed to account for the variation in the students' ability to 
interpret emotional expressions. 4) The differences between schools 
interpreted and the differences among grade levels did account for a 
' significant proportion of the variance. 



OBSERVING CLASSROOM BEHAVIOR II 
Predicting Social Studies Teacher Behavior 

C. KENNETH MURRAY and HUGH J. TREANOR, West Virginia 
University 

This investigation sought to examine the Teaching Situation 
Reaction Test (TSRT) as a predictor of teacher verbal and cognitive 
classroom behavior patterns. Thirty social studies teachers comprised 
the sample for this study which represented the upper and lower 
quartiles of a population of 60 teachers who responded to the TSRT- 
The dependent variables were verbal and cognitive classroom behaviors 
(measured by systematic observation techniques). A U Test was 
employed to test the differences between the ranks of the two groups 
of teachers. The data suggest that the TSRT has potential for predicting 
classroom behavior related to current developments in social studies 
instruction. 

Use of Systematic Classroom Observation to Validate a Measurement of 
Teacher Beliefs About Teaching 

GORDON D. LAWRENCE, University of Florida 

Systematic classroom observation involving four observation 
systems (Reciprocal Category System, Teacher Practices Observation 
Record, Florida Taxonomy of Cognitive Behavior and Florida Climate 
and Control System) was used to validate a paper and pencil 
instrument The latter was designed to measure teacher concepts about 
what constitutes good teaching practices in middle schools. From 320 
instrument respondents 40 teachers were selected for observation. 
Correlations were found between 81 items and the various categories of 



the observation systems. In effect, the teacher attitudes represented in 
the responses to the 81 items were shown to have counterparts in 
observable behavior patterns in the classroom. 

A Comparison of Observed Teaching Behavior of Oral Language 
Program Trained and Conventionally Trained Preservice Reading 
Teachers 

DAVID R. KNIEFEL, North Carolina State University 

An observational study employing the Spaulding Teacher Activity 
Rating Scaie and the Motor Behavior Description Categories (developed 
by the researcher) was conducted to objectively describe and compare 
teaching behaviors exhibited by two groups of preservice reading 
teachers who were involved in different experiential training modes. 
Video taped test teaching situations were observe! and the resultant 
behavior profiles were subjected to multivariate profile analysis. The 
results indicated that teachers trained with the Oral Language Program 
exhibited consistent behavior patterns between teaching situations 
while the conventionally trained teachers ware significantly inconsistent 
on the social behavior management dimension of behavior. 

Behavioral Expression of Teacher Attitudes 

THOMAS L. GOOD, University of Missouri, Columbia; JERE E. n 
BROPHY, University of Texas, Austin 

In a replication and extension of work by Silberman (1969), 
differential teacher behavior toward different students was studied in 
relation to the attitudes teachers held toward these students. Using data 
on dyadic teacher-child interactions collected with the Brophy-Good 
system, contrasting patterns were noted in the ways teachers interacted 
with students toward whom they felt attachment, concern, indiffer- 
ence, or rejection. Four distinct patterns were observed. The data 
generally confirmed Silberman's earlier findings. Methodological 
differences which may explain the discrepancies which did occur are 
disc&ssed, along with suggestions for related research. 

Educators' Non-Verbal Interactions in a Laboratory Setting 

EVAN R. POWELL and VIRGINIA C. DENNIS, University of Georgia 

A laboratory experiment was conducted with 28 Black and white, 
male and female Educators in dyadic interaction with a B/W, M/F 
stranger of fixed location, position, and gaze. Race and sex of stranger 
influenced Educator-set interpersonal distance, gaze, and bodily orien- 
tation in a one-minute encounter as hypothesized. If many school 
personnel do vary these interpersonal intimacy dimensions uncon- 
sciously, (possibly following cultural norms), they should be made 
gware of these unintentional messages that may be perceived as racially 
or sexually discriminatory by recipients such as other staff, parents, and 
students. 



PIAGETIAN TASKS 

The Development of a Group Film Test of Certain Piagetian 
Conservations 

GRAYSON H. WHEATLEY, Purdue University 

The purpose of this study was to determine the feasibility of using a 
film to assess the Piagetian conservations. Two parallel tests were used, 
an individual manipulative (IMT) and a group film test (GFT). The 
subjects were 148 first-grade and 450 second-grade Ss. A subsample of 
the first-grade Ss received both the IMT and the GFT* The correlation 
of scores on the IMT and the GFT was .86. Other statistical 
comparisons were made. The results show that a GFT can be effectively 
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used to assess conservation with the obvious implications for research 
and instruction- 

EffectS of Selected Experiences on the Classification and Seriation 
Abilities of Young Children 

MARTIN L. JOHNSON, Rutgers University 

A sample of eighty-one first and second grade children from two 
Atlanta elementary schools was randomly partitioned into experimental 
and control groups. The experimental children were given experiences 
in sorting and seriating linear objects. The main effects of treatment 
(p < .01) and grade (p < ,01) were significant on a seriation test. Grade 
effect (p < .05) and school effect (p < .05) were significant on a 
conservation test, with school effect (p < >05) significant on a 
transitivity test. No relationships could be detected between classifi- 
cation performance and treatment, school, or grade; between classifi- 
cation and transitive ability using "same length as"; or between 
seriation and transitive ability using "shorter than" and "longer than." 

The Modification of Age-Specific Expectations of Piaget's Theory of 
Development of Sntenticna’ity in Moral Judgments of Four- and 
Seven-Year-Old Children in Relation to Use of Puppets in a Social 
(Imitative) Learning Paradigm 

JOHN M. REEVES, Heritage Health Center; WILLIAM B. MICHAEL, 
University of Southern California 

An experimental investigation with forty children from ages four to 
seven who were exposed to a twenty-minute film involving puppets as 
models to act out Piaget-type stories and affording vicarious reinforce- 
ment from a six-year-old peer yielded results inconsistent with 
age-specific expectations of Piaget's theory regarding acquisition of 
moral judgments that requires a distinction between social acts of 
intentionality or accident. With respect to both an immediate and a 
two-week delayed posttest devised to reflect intentional choices or 
accidental consequences in moral judgments, significant differences 
suggested that the film aided children in comprehending intentionality 
irrespective of age. 

The Object Sorting Task as a Predictor of Learning Outcomes 

RICHARD BLOOM and ROBERT HESS, State University of New 
York, Stony Brook 

One hundred fifth grade black and white children (Ss) were given 
the Object Sorting Task (OST) as a means of assessing divergent and 
convergent thinking. The Ss were also given five associative and 
conceptual learning tasks. Data were also obtained on achievement and 
I.Q. test scores. Correlational analysis indicated that the white sample 
showed a substantial number of interrelationships between the OST and 
I.Q. indexes, as predictors, and various learning measures. Relatively 
few such relationships were observed for the black sample. These results 
suggest the possibility of difference in the organization of basic learning 
parameters for white versus black children. 

Piagetian Operations and Field Independence as Factors in Children's 
Problem Solving Performance 

CAROLYN L.SAARNI,New York University 

The investigation studied Piagetian developmental level and Witkin's 
field independence construct as predictors of young adolescents' 
problem solving performance. Field independence was nested within 
Piagetian level in a multivariate analysis of variance, which yielded a 
significant main effect for Piagetian level on problem solving per- 
formance; however, the nested factor field independence was non- 
significant. Sex differences were also analyzed: no significant sex 
differences were found in Piagetian level, but significant sex differences 



were found in field independence (Rod and Frame test). The formal 
operational girts were also significantly more field dependent than their 
concrete operational peers. 



PROBLEM SOLVING: MATHEMATICS 

The Relation Between the Development of Certain Conservation and 
Measurement Concepts 

THOMAS P. CARPENTER, Boston University 

One hundred and twenty-nine Ss in grades 1—2 were individually 
tested on 13 items designed to investigate the relationship between 
certain conservation and measurement concepts and to determine the 
role of equivalence and nonequivalence relations in conservation and 
measurement problems. Contrary to Piaget's conclusions, Ss in the 
earliest stages of development did not rely primarily on perceptual 
judgments. Distracting numerical cues led to the same number of 
incorrect responses as did visual cues. Correct numerical cues led to 
significantly (p < .01) more correct responses than correct visual cues. 
No significant differences due to different combinations of equivalence 
and nonequivalence relations were found. 

Some Factors Associated with Pupils' Achievement When Solving 
Selected Types of Simple Open Sentences 

J. FRED WEAVER, The University of Wisconsin, Madison 

An Inventory was developed to investigate young pupils' achieve- 
ment when solving simple open sentences (derived from basic number 
facts) which reflected selected mathematical characteristics. Significant 
main effects and numerous significant interactions were observed for 
the following factors: grade (1, 2, 3), sentence form as determined by 
the symmetric property of equality (a o b = c, c = a o b), operation 
specified (+,-), placeholder position (a, b, c), and existence/ 
nonexistence of a whole-number solution. Findings suggest that if open 
number sentences are included in school programs for young children, 
relevant mathematical factors should be considered more carefully. 

Some Factors Associated with Children's Solving Performance on Four 
Types of Mathematical Open Sentences 

DOUGLAS A. GROUWS, University of Missouri, Columbia 

In this study the relationship between children's performance in 
solving certain open sentences and three factors (Open Sentence Type, 
Number Size, Context) associated with these open sentences was 
investigated. Sixteen open sentence solving tasks were individually 
presented to each of thirty -two randomly selected third grade children. 
Multivariate analysis of variance on the number of correct solutions on 
linear combinations of solving tasks indicated that there were signif- 
icant differences in children's solving performance on the four types of 
open sentences and on the two levels of number size. There also was a 
significant Open Sentence Type X Number Size interaction. 

Use of Matrix Sampling Procedures to Assess Achievement in Solving 
Open Addition and Subtraction Sentences 

MARGARIETE A. MONTAGUE, University of Wyoming 

This study investigated the feasibility of concurrently and randomly 
sampling examinees and items in order to estimate group achievement. 
Seven 32-item tests reflecting a 640-item universe of simple open 
sentences were used such that item selection (random, systematic) and 
assignment (random, systematic) of items (four, eight, sixteen) to forms 
were varied. Twenty-four second or third grade populations were 
randomly selected. Analysis of variance was used to examine the data. 
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Nonsignificant differences were observed with respect to item selection, 
item assignment, and number of items per form. Results support the 
appropriateness of the procedure for estimating group achievement. 



PROBLEMS IN READING 

An Evaluation of Auditory Perception Training and Supplemental 
Reading Instruction for Children with Auditory Perception Disorders: 
A Two Year Follow Uft 

FERN C. WILLIAMS, THOMAS OAKLAND and WILLIAM HARMER, 
University of Texas 

Previous research shows lower SES children to be deficient in 
auditory perception abilities and reading achievement and suggests that 
deficits in auditory abilities may attenuate development of reading 
skills. In 1968-69 two strategies were implemented in an attempt to 
increase reading achievement of lower SES first graders: (1) auditory 
perception training; (2) supplemental reading instruction which does 
not rely heavily upon auditory perception abilities. Two year follow-up 
data on the children indicates auditory perception training alone does 
not increase reading achievement. Reading instruction designed to 
circumvent perceptual deficits may prove effective and deserves further 
research. 

Differences in Learnabiiity of Content and Function Words Presented 
in Isolation and Oral Context When Taught to High and Low 
Socio-Economic Level Subjects 

ROBERT DAVIS CHESTER, University of Wisconsin 

The purpose of this investigation was to gather empirical data 
concerning the learnabiiity of content and function words taught in 
treatments of isolation and oral context to groups of prereading first 
grade pupils in high and low socio-economic levels. One hundred twelve 
subjects were tested through a paired-associate task and the data were 
analyzed in a 2x2x2 analysis of covariance. Of the main effects— 
word class, treatment, and socio-economic level— only the latter two 
were significant at the .01 level. No interactions were significant. 
Results indicate that socio-economic" level and context may be 
important factors in initial learning. 

Application of Group Contingent Reinforcement with Slow Learning, 
Culturally Deprived Children 

JOHN F. JACOBS, Southern Illinois University 

Rural, culturally deprived, slew learning children (N = 130) were 
«• randomly assigned to one of five experimental conditions: Control, 
random reward, individual reward, group reward, and combined group 
and individual reward with teachers randomly assigned on a daily basis 
as a control for teaching skill and teacher-class interaction. Gain scores 
on five subtests of the Stanford Achievement Test Battery (using 
ANOVA and t-tests) indicate group reward conditions achieved more 
than twice the historic rate of gain or the gain under control conditions. 
Data further suggest that group contingencies are approximately twice 
as powerful as individual. 

Reaction Time in Learning- Disability and Normal Children 

CARL J. SPRING and JOHN B. HOPKINS, University of California, 
Davis 

Poor readers and normal readers were matched on age (7-12) and IQ 
(94-130). Two letters were presented simultaneously. Ss responded b\r£ 
pressing one switch if the letters were the same, and another if 
different. Reaction time was longer for poor readers. In addition, 
reaction times increased during testing, and decreased after a rest, more 



for poor than normal readers. Correlations between initial reaction 
times and changes were significantly different for poor and normal 
readers. Results are interpreted as support for a theory that certain 
learning-disability children respond to laboratory tasks with sub- 
optimal levels of arousal. 

Language Factors in Judging Educational Potential 

STANLEY F. WANAT, International Reading Association 

Inquiry into language factors was used in judging educational 
potential. First, current knowledge base in this area of research was 
analyzed. Sub-areas include: differences between "school" English and 
other varieties, psychological barriers encountered by biculturals, and 
assumptions about language varieties underlying instructional strategies. 
Second thrust was interviewing a sample of educators about the kinds 
of linguistic criteria employed in making such judgments. The third 
thrust is an experimental study of linguistic factors actually affecting 
these judgments. Categories of linguistic factors being field tested 
include: paralinguistic, phonological, grammatical, and lexical. 

Interactions between perceived student and teacher characteristics are 
of particular concern. 



PROSE LEARNING I 

Acquisition and Long-Term Recall of Text Surrounding Complex 
Relational Sentences 

PERSIS T. STURGES, Chico State College; LAWRENCE T. FRASF., 
Bell Laboratories 

Adults learned a text (with unlimited or restricted reading time) in 
which three forms of critical sentences were embedded: simple factual, 
or complex inclusion and temporal content. All Ss had three acquisition 
trials, each followed by free recall and, seven days later: free recall; 
prompted recall of facts from the text; and two prompted recall tests 
on critical sentences. Recall of material surrounding different kinds of 
content did not differ. However, the critical sentences did differ on all 
measures, with inclusion best and temporal worst; and retention of 
inclusion relations showed no loss over seven days. 

Effect of Complex Text Sentences upon Recall for Surrounding 
Information 

LAWRENCE T. FRASE, Bell Laboratories 

Can complex relations in a text monopolize processing or storage 
space, thus inhibiting the acquisition of subsequent information? 
Adults learned a text (under paced or unpaced conditions) in which 
complex logical and temporal relations were embedded. After reading, 
Ss answered a prompted recall test covering material that immediately 
preceded and followed simple factual, or complex logical and temporal 
content. Under unpaced conditions, recall of the material preceding or 
following the different kinds of content did not differ. Under paced 
conditions, recall for material following the logical and temporal 
relations was depressed. Two other studies failed to replicate the latter 
finding. 

Anxiety, Instructional Pacing, and the Comprehension of Fact and 
Inference in Learning from Discourse 

ANTHONY L. TRUOG, Wisconsin State University, Whitewater; 
FRANK H. FARLEY, Wisconsin Research and Development Center for 
Cognitive Learning, University of Wisconsin 

Literal and inferential comprehension of a 2,000 word passage of 10 
approximately equal pages was studied as a function of presentation 
rate (15 vs. 30 secs, per page) and anxiety. General anxiety (Eysenck 
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Personality Inventory) had no main effect on either literal or inferential 
performance, but the slower rate significantly facilitated literal per- 
formance. A significant interaction of anxiety and presentation rate was 
obtained for literal performance only. High anxiety was associated with 
poor performance at the slow rate but superior performance at the fast 
rate relative to performance characteristic of low anxiety. 

The Relationship of Cognitive Flexibility to Learning of Prose Material 
Differentially Classified According to the Taxonomy of Educational 
Objectives: Cognitive Domain 

REED G. WILLIAMS, Southern Illinois University 

The study investigated the nature of the relationship between 
cognitive flexibility and the ability to learn prose material differing in 
cognitive demand. It was hypothesized that cognitively flexible Ss 
would perform significantly better on the comprehension, application 
and analysis levels than would subjects characterized as less flexible. 
Flexible and non-flexible individuals would not differ in performance 
on knowledge level tasks. Fifty-four college youth were administered a 
learning task incorporating subtasks from the first four levels of the 
taxonomy and the PM scale, a measure of cognitive flexibility. Multiple 
linear regression analysis supports the research hypothesis (p < .05). 

Raters' Predictions of the Recallability of Expository Prose as Related 
to Actual Recall 

RONALD E. JOHNSON, Purdue University 

Various samples of college students attempted reproductions of 
textual prose immediately after learning or after a seven-day retention 
interval. An independent group of raters made predictions regarding the 
linguistic subunits which would be most frequently remembered. The 
data provided strong evidence that learners possess knowledge as to the 
textual subunits which are likely to be learned and remembered. 
Additional analyses showed that judgments of predicted recall are 
closely related to judgments of meaningfulness and also to judgments of 
structural importance. 



PROSE LEARNING II 

The Direction of the Effect of Questions in Prose Material 

V 

BARRY McGAW and ARDEN D. GROTELUESCHEN, University of 
Illinois 

The study ascertained the difference in functions and loci of shaping 
and review in facilitating learning from prose material contained in The 
Sea Around (Js. The initial effect of inserted questions appeared to be 
forward, shaping Ss inspection behaviors to bring Ss to attend to details 
of the text relevant for answering the questions. Once the initial 
shaping had occurred the inserted questions appeared instead to exert a 
backward effect, facilitating performance by forcing review of material 
just read. This facilitation through review was greatest for criterion 
items dealing with the substance of the text tested by the inserted 
question. 

Differential Responseto Question Pacing in Learning from Prose 

MARY LOU KORAN and JOHN J. KORAN, JR., University of Florida 

In an experiment designed to explore the interaction of individual 
differences with question pacing in learning from written materials, 92 
Ss were administered aptitude tests representing verbal and memory 
abilities, then randomly assigned to treatments in which questions were 
placed after every one or four pages, or omitted from a prose passage. 
Posttest analysis of relevant and incidental retention showed that 
relevant retention increased with question frequency, however no 



between-group differences were found in incidental retention. Multiple 
regression analysis of Aptitude x Treatment interactions showed that 
aptitude measures interacted significantly with treatment conditions for 
incidental retention. 

Output Interference in Prose Learning 

WILLIAM McKENDREE BOYD, Memorial University of New- 
fou ndland 

Ninety-six college Ss were given a passage with 5 or 10 questions 
after every five paragraphs, or no questions (controls) and either a short 
or long criterion test, consisting of intentional questions, identical to 
those in the paragraphs, and incidental questions, unrelated to the 
interspersed questions. The long test produced a lower percentage of 
correct items than the short test. Intentional scores were all above 
controls. For Ss given the short test, incidental scores were above the 
control scores— a general facilitative effect. On the long test they fell 
below the controls. 

Effects of Response Requirement Type, Placement, and Category Upon 
Attention Patterns Influencing Prose Learning 

EDYS S. QUELLMALZ, Southwest Regional Laboratory for Educa- 
tional Research and Development 

To identify techniques which direct attention to text relevant to 
prose learning, the effects of response requirements embedded within a 
thirty-six page text which varied by Type (Questions or Objectives), 
Place (Before or After text segments) and Category (identification of 
names or applications of principles) were investigated. For pages one to 
eighteen, response requirements were of one category (names), for the 
second half, of a different category (applications). Significant results 
were found for Relevant test scores compared to Non-Relevant and 
Incidental scores, for Relevant items when text questions occurred after 
text, and for higher Incidental items after the category switch. 

An Investigation of the Effects of Type, Location, and Distribution of 
Orienting Stimuli on the Acquisition and Retention of Meaningful 
Prose Materials 

JAMES P. PAPAY and BOBBY R. BROWN, Florida State University 

The effectiveness of behavioral objectives (BO), questions (QU), and 
advanced organizers (AO) at pre- and postlocation with massed and 
distributed presentation modes was investigated by presenting 317 Ss 
with a 3000-word prose passage. Multivariate AN OVA and ANACOVA 
on immediate retention and delayed retention scores disclosed that the 
orienting stimuli were instructional ly effective. Moreover, QU best 
facilitated learning with the distributed postlocation; whereas, AO 
favored the massed prelocation. The BO was most effective at 
prelocation, but the optimal distribution and type recall remained 
inconclusive. Overall, AO optimized comprehension, prelocated QU 
maximized factual recognition, while postlocated QU facilitated 
comprehension. 



PROSE LEARNING III 

The Influence of Imagery on the Recall of Sentences in Prose 

H. PARKER BLOUNT and RONALD E. JOHNSON, Purdue University 

The purpose of this study was to examine the influence of imagery 
on the recall of prose. A study was made of the influence of differing 
imagery level nouns as the subject and object of the preposition of a 
sentence. The sentences were written so that concrete-concrete, 
concrete-abstract, abstract-concrete, and abstract-abstract subject- 




51 

62 



object noun pairs were interchangeable. The concrete-concrete subject 
and object noun sentences were recalled significantly better than the 
concrete-abstract, and the abstract-abstract sentences. The concrete- 
abstract and the abstract-concrete sentences were recalled significantly 
better than the abstract-abstract sem ^nces. 

Experimental Manipulation of Reading Strategies 

GEORGE W.McCONKIE, KEITH RAYNER and STEVEN J. WILSON, 
Cornell University 

College undergraduates read a series of passages each followed by 
the same type of questions. Groups receiving different questions 
adopted different reading strategies, picking up different types of 
information. Factual and higher-order strategies were very similar. 
Payoff conditions influenced reading speed. For students reading for 
factual and higher-order information, reading speed affected the 
amount of incidental information gained, but had no effect on the 
types of information for which they were specifically reading. This does 
not hold for all strategies, however. 

Psycholinguistic and Reading Abilities of Educable Mentally Retarded 
Readers 

SHIRLEY B. MERLIN, Madison College; M.S. TSENG, West Virginia 
University 

Measures of psycholinguistic and reading abilities of 25 EMR good 
readers and 25 EMR poor readers were compared with ANCOVA. 
The good reader group showed significantly higher abilities in auditory 
association, auditory reception, grammatic closure, manual expression, 
visual closure, visual sequential memory, automatic level of organiza- 
tion, representational level of organization, auditory communication, 
visual communication, and psycholinguistic age; and in average reading, 
word recognition, oral reading, silent reading, and listening comprehen- 
sion. Psycholinguistic age (r=.68, p<.001) proved to be a more 
powerful predictor of average reading than mental age (r = .33, p < .05) 
and IQ did not correlate with average reading. 

The Effects of Imagery and Rote Repetition Instructions on the Ability 
to Reason from Logical and Scrambled Sequences 

SANDRA G. KOSER, Cornell University; GERALD L. NATKIN, 
Louisville Public Schools 

This study investigated the use of imagery as a memonic aid. 
Seventy-two Ss read five scrambled or five logically sequenced 
paragraphs under imagery or rote instructions. All Ss were tested on 
their ability to draw inferences from the passages. Regardless of 
instructions, logical sequence resulted in superior inference making. 
There was also an instructions x sequence x trial blocks interaction. 
With scrambled texts and imagery instructions inference making 
improved with practice; with scrambled texts and rote instructions, it 
deteriorated. These results supported the hypothesis that imagery and 
logical sequence can function to reorganize text, thereby making it 
easier to remember. 



RADICAL ACCELERATION OF EXCEPTIONALLY BRIGHT 
STUDENTS 

From Eighth Grade to Selective College in One Jump: Two Case 
Studies in Radical Acceleration 

DANIEL P. KEATING and JULIAN C. STANLEY, Johns Hopkins 
University 

We review literature on gifted children as it applies to the decision 
to accelerate or not to accelerate exceptionally bright students who are 



also high achievers in science and mathematics. Problems and possi- 
bilities are illustrated by case studies of two 13-year-old boys who went 
directly from the eighth grade of public schools to the freshman class of 
a selective university and succeeded well. Our review of previous studies 
indicates that, in the present educational structure, considerable 
acceleration is the best alternative for some students. Better methods 
remain to be devised. Considerations leading to them will be discussed. 



READING: COMPREHENSION 

Children's Verbal Learning and Comprehension in the Aural and Visual 
Modes 

DAVID V. WILLIAMS, Ithaca College; JOANNA P. WILLIAMS, 
University of Pennsylvania 

Paired associates, sentences and prose passages were compared in 
auditory and visual presentation to fourth and sixth graders. Immediate 
and delayed measures of memory/comprehension were employed. The 
materials represented classroom task paradigms as well as those in the 
experimental literature. The auditory mode was significantly superior in 
the prose-delayed condition. A second study demonstrated the effects 
of "availability" of stimulus materials across modes pointing to the 
need for a clearer understanding of variables associated with mode. 
Additional studies are proposed. 

Effect of Prompting and Relevant Reading upon Children's Compre- 
hension and Recall of Logical Content 

ERNEST D. WASHINGTON, University of Massachusetts; LAWRENCE 
T. FRASE, Bell Telephone Laboratories 

Studies attempted to improve children's ability to draw inferences 
by emphasizing text structure. In one study, 32 fourth graders answered 
rote or inferential questions from text. Half were prompted to pay 
attention to the terms that mediated connections between sentences. 
Prompting did not affect performance on rote questions, but prompted 
Ss scored 30% higher on inferential questions. In another study, 72 
children from Grades 3-5 read varying numbers of passages exemplify- 
ing a particular logical structure, and they answered rote or inferential 
adjunct questions. Amount of relevant reading and type of adjunct 
question did not affect the learning of two transfer passages. 

What is Recalled After Hearing a Passage? 

BONNIE J. F. MEYER and GEORGE W. McCONKIE, Cornell Uni- 
versity 

In order to determine what aspects of information from prose are 
available for recall after one presentation of a passage, and what aspects 
are learned with additional presentations, two passages were divided 
into idea units. These units were placed in a logical, hierarchical 
structure for each passage, and scores were assigned to the idea units on 
the basis of their position in the structure. Effects of the logical 
structure were seen in the kinds of idea units which were remembered, 
the stability of these units in consecutive recalls, and the tendency for 
clustering of idea units on this basis. 

Comprehension of Telegraphic Prose 

CLESSEN J. MARTIN and MARY ANNE HERNDON, Texas A&M 
University 

The purpose of this study was to assess the effects of telegraphic 
prose upon the comprehension of oral and written messages. Tele- 
graphic prose is based upon the assumption that written and spoken 
language contains many words and word sequences which are unneces- 
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sary for the. efficient communication of information. A total of 160 Ss 
were tested in two experiments in which the Ss were assigned to four 
treatment groups: Visual-Traditional, Visual-Telegraphic, Auditory- 
Traditional, and Auditory-Telegraphic. Although there was a nificant 
difference in comprehension between telegraphic and raditional 
messages (12% less comprehension for telegraphic messages), 60% less 
time was spent reading telegraphic passages. 

Implication of Racial Identification of Story Characters and Influence 
on Affect and Comprehension 

ROBERT L. AARON, University of Georgia 

Black and white fourth, fifth, and sixth graders read stories 
imputing to two principal characters clear protagonist and antogonist 
roles, and identifying them racially as black and white. Black subjects 
show affect to the protagonist when he is identified racially, but whites 
seem to rate more on descriptive characteristics of the role read about, 
rather than on race. For bc*h groups, ratings of the initially negative 
white role went to a more positive score as the antagonist image 
changed to protagonist in the last half of the story. The affectivrty of a 
story is clearly dominated by the role description employed, especially 
for black pupils. 



READING: DECODING 

A Psycho linguistic Comparison of Oral Reading Errors of Good, 
Average, and Poor Readers in Third Grade 

JAMES E. COOMBER, Concordia College 

The objective of the study was to find differences in the decoding 
strategies of good, average, and poor readers in the third grade. A 
linguistic analysis of oral reading errors was the method used. 
Phonetic-graphemic evaluations of errors revealed differences between 
the three ability groups in use of grapheme-phoneme correspondences. 
Syntactic measures revealed no differences between groups in pro- 
ficiency in using syntactic context. Most of the errors of all three 
groups conformed to syntactic context. These results suggest that the 
poor reader has a mastery of sentence structure but lacks adequate 
phonic skills and sight vocabulary. 

Assessment of Subskills Related to Novel Word Decoding 

ROBERT E. RUDEGEAIR and R. JAMES MINEO, Southwest 
Regional Laboratory for Educational Research and Development 

A study was conducted to assess the ability of phonics-trained 
kindergarten Ss to pronounce unfamiliar words. In addition to the 
unfamiliar word test, four tasks designed to reflect a hierarchy of 
decoding subskills were administered to the same Ss to determine which 
subskills low-ability decoders have failed to acquire. Results showed 
that while high-ability decoders can perform all tasks with ease, middle 
and low-ability decoders exhibit poorer performance as task complexity 
increases. Data on performance with regard to different units of word 
analysis is also reported. 

Novel Word Decoding in Kindergarteners as a Function of Decoding 
Strategy and Segmentation-Blending Training Form 

JOHN KOEHLER, JR., Southwest Regional Laboratory for 
Educational Research and Development 

An investigation of how segmentation-blending (SB) training form 
affects the application of decoding strategy (WD) to novel word 
decoding was conducted on kindergarteners. Combinations of 2 WD 
strategies and 6 SB forms ware applied to 12 groups of 6 children. The 
word decoding data indicated that the strategy involving C-VC and 



CC-VC elements for CVC and CCVC words transferred best with 
sounding out training, whereas this SB form was no better than one 
involving both blending and element identification ftr the strategy 
having CV-C and C-CVC elements. Implications of these and other 
results for phonics reading instruction are examined. 

Learning and Transfer Effects of Variations in Word-Decoding 
Instruction 

MASAHITO OKADA, HOWARD J. SULLIVAN and EDWARD 
HIRSCH, Southwest Regional Laboratory for Educational Research 
and Development 

This study investigated the effects of three different word-decoding 
instructional procedures in grade 1: a single-letter (SL) approach, a 
letter-combination (LC) approach, and a procedure in which children 
receive several weeks' instruction in the SL method and then switch to 
the LC approach. There were no significant differences between the 
three groups in achievement on the 32-item posttest measuring the 
ability to read words encountered during instruction and the ability to 
sound out and read new words, but each treatment group scored 
significantly higher on the posttest than did a control group receiving 
regular first-grade reading instruction. 

Effects of Teaching i.t.a. to Inner-city Black Children in Kindergarten 
and First Grade 

WAI-CHING HO and FREDRICK E. MENZ, Educational Research 
Council of America; CHARLES F. EISZLER, Central Michigan 
University 

This study investigated two major problems: (1) Can inner-city 
black children learn to read in kindergarten using i.t.a.? (2) Does i.La. 
help inner-city black children improve proficiency in reading and other 
language skills? Results indicate that inner-city black children can learn 
to read in kindergarten through the i.t.a. medium. By the end of 
kindergarten, the i.t.a. group performed significantly better than the 
T.O. group on Auditory and Visual Discrimination, Sound-Symbol 
Association, Word Recognition, and Meaning. The i.t.a. group also 
surpassed the T.O. group in reading skills, writing and oral language at 
the end of grade one. 



REASONING AND LOGICAL THINKING 

Some Developmental Trends in Inferential Thinking Among Ele- 
mentary School Children 

GARY R. McKENZIE, University of Texas, Austin 

In individual interviews, Ss who were randomly selected from one 
elementary school (N = 133) were shown photographs of activity in an 
unfamiliar society and asked four pairs of questions, the first calling for 
interpretation and the second calling for evidence supporting the 
interpretation. Responses were classified by accuracy of interpretation 
and type of support offered. Frequency-of-use-scores on five types of 
interpretations and six types of justifications were compared between 
ages by ANOV. Older 3s interpret photos more accurately than younger 
3s, and use photographic evidence to support inferences more than 
young Ss. Young Ss frequently ignore photographic evidence. 

Children's Inductive Reasoning Performance on Picture Stimuli 

WILLIAM F. COX, JR. and HAROLD J. FLETCHER, Florida State 
University 

Eighty subjects 4, 6, 8, and 10 years of age inductively identified 
partially uncovered silhouettes of 3 simple pictures. Subjects removed 
as few as possible covering pieces, according to their own strategies, to 
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correctly name the pictures. Performance generally improved with 
increased age on the two dependent measures, inductively inferring the 
identity of incomplete pictures and efficiently removing pieces on the 
silhouettes. A plateau in performance existed on the inductive inference 
measure between ages 6 and 8. Results indicate that young children 
reason inductively on nonwritten tasks judged appropriate for studying 
more complex forms of induction. 

Development of a Thinking and Reasoning Component for Preschool 
Children 

HARRIS W. STE^N and JANICE FREEMAN, Southwest Educational 
Development Laboratory 

This session will be devoted to a presentation of various aspects of 
the development of a curriculum component to teach higher level 
thinking skills and problem solving to preschool children from low 
income Chicano and Black families. This component is a new addition 
to the Early Childhood Curriculum of the Scvthwest Educational 
Development Laboratory. The report will discuss the theoretical 
framework used to generate the curriculum lessons; it will describe the 
component itself and some of the lessons included in it; and it will 
present data from various experimental and field studies carried out in 
conjunc^on with the development effort. 

A Study of Logical Thinking 

RONALD E. LESHER, Bucks County Intermediate Unit 

Two aspects of logical thinking were singled out for study: 
syncretistic understanding and logical thinking as measured by the 
Logic Test (O'Brien and Shapiro, 1968). Analysis showed significant 
gap between seventh grade students and fourth through sixth grade 
students on both aspects of logical thinking. j\ trend analysis showed a 
leveling off or plateauing in sixth grade. Care should probably be taken 
in what types of logical thinking are actually demanded of elementary 
grade students. 

Tra>r*^g and Transfer of Problem Solving 

MICHAEL J. LOUPE, University of Minnesota 

A two-part experiment was completed to test the amenability of 
problem solving techniques to short term training and to test the degree 
which these techniques transferred to a different situation and were 
manifest in terms of improved problem solving. Twenty Ss were trained 
in a 3 hour program to look for problems, define the problem, generate 
explanatory hypotheses, define testing plans, search for information 
according to the plan and redefine the problem in light of new 
information. When compared to a comparable control, trained Ss 
showed transfer in some behaviors. Possible implications were explored. 



REINFORCEMENT and FEEDBACK I 

Increasing Rate and Accuracy of Academic Performance Through the 
Application of Naturally Available Reinforcers 

BETh SULZER, SHARON HUNT and ANDY LOVING, Southern 
Illinois University 

To determine if the activities of most school programs could be 
contingently utilized to increase accurate academic performance rates, a 
special class was organized with nine elementary students identified as 
having motivational problems. Each was individually assigned to work 
on two subject areas. Following a baseline period, students were 
required to purchase access to activities like crafts and games, with 
points for correct work. Points were earned in one, later in both subject 



matter areas. Using a multiple baseline design, results demonstrated that 
making access to naturally available reinforcers contingent upon correct 
items increased both academic and classroom behavioral performance. 

Generalization of Reinforced Behaviors in a Game Situation 

GAIL HAY MARCHASE, Johns Hopkins University 

The generalization of reinforced behaviors operationally defined as 
competitive or cooperative was studied using twenty-eight kindergarten 
children in a 2 x 2 design, praise and tokens were employed in a game 
to reinforce the competitive behavior of winning or the cooperative 
behavior of working together. Two generalization measures were taken. 
Analysis of variance revealed that the plurality of helping responses 
given by Cooperative treatment subjects reached significance only in 
the measure more similar to the treatment situation, supporting a 
generalization gradiant interpretation. There were no significant sex 
differences. Results support the suggestion that behavior modifiers 
consider concomitant changes in behaviors other than target behaviors. 

Teaching Mothers to Use Behavior Modification Techniques with their 
Mentally Retarded Children 

BARBARA A. DOTY, North Central College 

The purpose of this study was to determine whether mothers could 
be trained to use behavior modification procedures to shape the 
behavior of their own retarded children. The mothers of 8 trainable 
children were instructed in the use of modification procedures in a 
laboratory situation, after which they used similar proceduresat home 
with their children over a 6-month period. Eight other mother-child 
pairs served as a control group. The results suggested that a relatively 
brief and inexpensive training program is effective in teaching mothers 
to shape multiple behaviors in their own retarded children. 

Group Therapy Readiness Using Operant Techniques With Mental 
Retardates 

MARC J. ACKERMAN, University of Georgia 

Following 4 weeks of unsuccessful conventional therapy, five 
trainable mentally retarded males were placed in a behavior modifica- 
tion "group-therapy-readiness" program (BMP). Immediategratification, 
short range decayed gratification and long range delayed gratification 
were used. Teachers were encouraged to continue the BMP in their 
classrooms. Desirable behavior was exhibited significantly more often 
(p < .005) during the BMP than before. There was no signif icant 
difference between the BMP sessions and follow-up sessions. Extinction 
was avoided through the use of varied reinforcement schedules and 
cooperation of the teachers. Operant techniques successfully readied 
mental retardates for a group therapy setting. 

The Effect of Teacher Verbal Mediation Training Upon Student Ability 
to Describe Consequences of Behavior 

RALPH O. BLACKWOOD and THOMAS H. MAXWELL, The 
University of Akron; LARRY L. LORTON, Akron Public Schools 

An extension of operant conditioning to verbal mediating self- 
control behavior, "Mediation Training," was investigated to determine 
if it facilitates student verbalization of behavior consequences. Ss were 
50 elementary students chosen by 1 1 teachers as their "best behaved" 
and 50 chosen as their "worst behaved" students. These were divided 
into "Mediation Trained" and control groups. A 2 x 2 ANOVA of pre- 
and post-treatment questionnaire results showed more verbalizations of 
behavior consequences by "Mediation Trained" Ss (p < .05). There was 
no difference between the "best" and "worst" behaved groups. Results 
indicate "Mediation Training" improves self-control and extends 
operant methods. 
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REINFORCEMENT AND FEEDBACK II 



The Effects of Verbal Reward and Punishment on Subject-Matter 
Growth of Culturally Disadvantaged First Grade Children 

JOAN K. HONEYCUTT, Ohio State University; ROBERT S. SOAR, 
University of Florida 

This study examined the relationship between teacher verbal 
behaviors and subject-matter growth with first-grade, Negro and 
Caucasian children participating in Project Follow-Through. Teacher 
verbal behaviors were assessed with the Reciprocal Category System. 
Pretest-posttest administration of the Metropolitan Readiness Tests was 
the basis for determination of adjusted gain scores which were utilized 
as the dependent variable. Analyses revealed no significant relationships 
between teacher verbal behaviors and subject-matter growth. A 
significant finding was that Negro children in racially integrated 
classrooms gained more on Subtest 1, Word Meaning. Interpretation 
and implications wil i be discussed . 

Factors Influencing "Learning Difficulty" in Programmed Instruction 

OWEN J. HORNUNG and ROBERT L. MORASKY, State University of 
New York, Plattsburg 

Based on the assumption that learning difficulty in programmed 
instruction is related to completion time and program response 
error-rates, an attempt was made to demonstrate that deletion of 
knowledge of results (KR) and the 1st Example (E) in the Rule- 
Example-Pos^Neg. Example teaching frame paradigm would increase 
learning difficulty. Four groups of 31 Ss each completed programs with 
the following designs: E & KR, E & No KR, KR & No E, and 

NoE&NoKR. Program response rates and work rates favored the 
inclusion of examples. KR influenced completion time when examples 
were deleted. It was concluded that examples in teaching frames were a 
factor influencing learning difficulty. 

Sustained Attention and Response Rate as a Function of Task 
Difficulty and Feedback Arrangements 

GLENN E. SNELBECKER, THOMAS HO LO HAN, STEPHEN WOLK 
and WILLIAM FULLARD, Temple University 

Two experiments focused on optimal conditions for presenting 
information in education and rehabilitation. Sustained attention (per- 
sistent responding on previously correct keys), response rate and 
response patterns were studied as a function of feedback arrangements 
and task difficulty. Data support the notion that providing frequent 
feedback in a complex task may momentarily enhance Ss' performance 
but may cause greater diminution of attention to cue stimuli than when 
either less frequent or no feedback is provided. Results are discussed 
with reference to theoretical models of attention and extrapolation of 
experimental single operant research findings to complex practical 
situations. 

Delay of Feedback and its Effect on the Retention of Three Types of 
Computer-Assisted Mathematics Instruction 

LORRAINE R. GAY, Florida State University 

To investigate the effect of feedback delay interval for three types 
of mathematics instruction (definitions, algorithms and proofs), 80 
undergraduates were assigned to 1 of 4 feedback conditions: 1) student 
received feedback immediately following a response; 2) feedback was 
received 30 seconds following a response; 3) feedback for all responses 
was received at the end of each instructional session; and 4) feedback 
for all responses was received 24 hours following each session. Delayed 
retention scores showed that a 30 second delay improved definition 
retention up to 12%, and that a 24 hour delay decreased proof 
retention up to 23%. 



Cognition and Frustration in Delay of Gratification 

v MARY LOU SCHACK and DAVID J. M ASS A R I, Temple University 

Sixty Black first-grade children were employed in a 2x3 design to 
investigate the effects of the cognitive variable of time and frustration 
level on self-imposed delay behavior. The factors were: (a) frustration 
level; presence or absence of both high and low valued rewards; and (b) 
time concept aid; timer plus instructions, timer minus instructions, 
no-timer control. Following ranking of rewards, subjects waited for 
their high valued reward or forfeited it for their low valued, but 
immediately available reward. The presence of rewards decreased 
waiting time, and the timer plus instructions condition increased 
waiting time, particularly in the high frustration condition. 



RESEARCH ON STUDENT ATTITUDES 

Differences in Value Patterns Among Sixth, Eighth, and Eleventh Grade 
Students 

DA VI D H. QUIST, Worcester State College 

The present study explored the value patterns of 1,100 sixth, 
eighth, and eleventh grade students to determine what differences in 
value patterns were present among these three groups of students. The 
students were all given a specially designed value inventory based on the 
Traditional-Emergent concept of values hypothesized by Spindler 
(1955). Significant differences on seven value dimensions were found. 
Overall a significant decline in Traditional values was in evidence. The 
results of the study indicate the importance of values in the school 
setting. 

What Instructors Learn from Students: Student and Faculty Ratings of 
Instruction 

JOHN A. CENTRA, Educational Testing Service 

The purpose of this study was to compare student ratings or reports 
on instruction with the teacher's own self-reports. Students and 
instructors responded to a 75-item "Student Instructional Report" 
which elicited both their descriptions and evaluations of classroom 
procedures. Differences between means for the two groups were 
significant for nine of the 75 items (p < .01), and on all of these nine 
items instructors rated or described their teaching more favorably than 
did their students. Correlations were not significant for 63 of the 75 
items (p < .01), indicating that for those items instructors and students 
tended not to concur strongly in their ratings or descriptions of 
instruction. 

Attitudes of Children Established by Classical Conditioning 

FRED BARNABEI, WILLIAM H. CORMIER, and SCHUYLER W. 
HUCK, University of Tennessee 

The purpose of this study was to examine attitudes of children 
established by classical conditioning. A posttest-only design was used 
with positive and negative word associations presented to the experi- 
mental group, and neutral word associations presented to the control 
group. Data were collected on all subjects from a semantic differential 
scale. Results of this study indicated that classical conditioning of 
attitudes occurred in the experimental group, and that this conditioning 
was effective without subject awareness. This study was important 
because it attempted to remove some of the ambiguity already present 
in studies dealing with classical conditioning of attitudes. 





The Effects of Being a Tutor upon the Attitude of High and Low 
Ability Elementary Students Toward Their Total School Environment 
and Reading Ability 

GRANT VOf4 HARRISON, Brigham Young University; MARY JANE 
PI DD, Utah State Learning Disabilities Center 

This study was designed to provide empirical data regarding the 
assumed benefits for students when they are utilized as tutors for 
younger children. High and low ability upper-grade elementary students 
were utilized as tutors for primary grade children. Both experimental 
groups were compared statistically with comparable control groups in 
terms of attitude toward the total school environment and reading 
ability. The low ability student tutors benefited much more from the 
experience than the high ability student tutors. 

Student Attitudes Toward the Teacher as an Authority Figure 

JOHN A. BURNS and PHILIP FRIEDMAN, Northwestern University 

Two hundred secondary school students (100 black, 100 white) 
from grades 7 to 11 were randomly selected from 4 inner city high 
schools. A questionnaire was administered which measured the 
student's own attitude and perceptions of peer and parent attitudes 
toward teacher authority. Parents and peers responded to the same 
attitude questionnaire. Student attitude scores were regressed on race, 
parent attitude, peer attitude, student's I.Q., achievement and voca- 
tional interest. Race was the most significant variable, accounting for 
approximately 29% of tht attitude score variance. While parent and 
peer attitude showed a small but significant relationship, age, achieve- 
ment and vocational interest had little effect on the student's attitude 
score. 



RETENTION 

Pictures and Imagery Training as Relational Organizers in Children's 
Learning 

FRED W. DANNER and ARTHUR M. TAYLOR, University of 
Minnesota 

The effects cf unitized pictorial relations and relational imagery 
training on the associative recall of elementary school children were 
investigated. From the recall data it was concluded that the poor 
performance of young children on associative memory tasks can be 
remediated by training in attending to and constructing relations. 

An Examination of the Facilitative Effects of Objectives, Grades, and 
Knowledge of Results on Classroom Learning 

GEORGE H. OLSON, Florida State University 

The facilitative effects of behavioral objectives (BOs), knowledge of 
results (KOR), and the assignment of grades on various stages of 
text-based classroom instruction were investigated. Students assigned to 
different cells in a 2 3 factorial design received either explicit BOs or 
non-explicit BOs, KOR or no KOR, and grades for quiz performance or 
no grades for quiz performance. As measured by post-test performance, 
the eight groups were equivalent. In terms of en route quiz per- 
formance, however, students in the graded conditions were found to 
take longer to work through the lessons and to make fewer errors on 
lesson quizzes. 

Word Frequency as a Discriminative Attribute of Memory 

R. PAUL STRATTON and KENNETH A. JACOBUS, University of 
Kentucky 

This study tested the hypothesis that word frequency functions as a 
discriminative, and not a retrieval, attribute of memory. The Ss were 



instructed to recall a "common" or "uncommon" word to a two-letter 

cue (e.g., f k). After the first and last two problems (of 16) a 

recognition test was given which consisted of all possible solutions. It 
was found that, although "uncommon" Ss could think of uncommon 
words, the order of recall was predicted by memory strength. That is, 
knowledge of the frequency of the target word did not help bypass 
memory strength as a determiner of word availability. 

The Effects of Verbal Instruction and Reinforcement on Concept 
Learning and Retention 

RICHARD L. BEATTIE, Central Missouri State College; BILL F. 
ELSOM, Oklahoma State University; ROBERT S. MEANS, Westchester 
State College 

The purpose of the present investigation was to determine if 
concept attainment and retention were influenced by verbal instruction 
and reinforcement. Forty Ss were randomly assigned to one of four 
treatment groups: Partial Reinforcement— Verbal Instruction; Con- 
tinuous Reinforcement— Verbal Instruction; Partial Reinforcement— No 
Verbal Instruction; Continuous Reinforcement— No Verbal Instruction. 
The results of a 2 x 2 A.O.V. were significant (p < .01) for both verbal 
instruction and continuous reinforcement which were superior in 
learning trials. Interaction effects were non-significant (p > .05). The 
results of a 2 x 2 A.O.V. were significant (p < .01) for both verbal 
instruction and continuous reinforcement which were inferior in 
retention trials. Interaction effects were not significant. 

Retroactive Inhibition in Free Recall as a Function of List Organization 

JANE PERLMUTTER and JAMES M. ROYER, University of 
Massachusetts 

A two by three factoral design was used to investigate the effect of 
list organization on retroactive inhibition (Rl) in free recall (FR). 
Categorized lists were used, with one independent variable involving the 
same (S), or different (D) categories in each list, or a control (C) which 
only studied one list. The other independent variable involved blocked 
(B), or random (R) presentation of the words. Significant Rl was 
exhibited by S and D groups, with more Rl in theS groups than in the 
D groups. No significant main effect was found between B and R 
groups. 



S0CI0 ECONOMIC AND ETHNIC FACTORS IN ACHIEVEMENT 

Concept Formation and Locus of Control Among Advantaged and 
Disadvantaged Students 

JUDITH S. GOLDEN, Marywood College 

With increased structure in the teaching-learning situation, it was 
expected that fifth graders external in locus of control would 
demonstrate increased concept formation performance relative to 
internal locus of control students. A levels (LSES, MSES) by levels 
(internal, external control) by treatment (baseline, increased structure) 
by repeated measure (level of difficulty) design was used. Nonverbal 
and verbal measures of concept formation were obtained. Externals 
surpassed internals under increased structure. Internals performed 
better with less structure. Nonverbal and verbal concept formation SES 
differences were not found. No SES locus of contro^ differences 
remained after screening for extreme age and achievement. * 

The Heritability of Jensen's Level I and II and Divergent Thinking 

THOMAS R. PEZZULLO, University of Rhode Island; ERIC E. 
THORSEN and GEORGE F. MADAUS, Boston College 

A heritability study employing 65 pairs of twins was conducted 
investigating the heritability of Jensen's Level I (operationalized using a 



modified "digit span" test), Jensen's Level II, or "g", the general 
intellective factor, (operationalized as the score on Raven's Progressive 
Matrices), and Divergent Thinking, (operationalized as scores on the 
Torrance Tests of Divergent Thinking). Null hypotheses concerning the 
heritability of Jensen's Level I and Level II were rejected (5%) while the 
Divergent Thinking hypotheses were not. The indices of heritability for 
Level I and II were .54 and .80, respectively, which indicate the 
proportion of concomitant variation between genotype and phenotype. 

An Experimental Field Study of the Impact of Nonverbal Communi- 
cation of Affect on Children from Two Socio-Economic Backgrounds 

RUTH MIDDLEMAN, Temple University 

Ninety fourth graders in an "inner city ghetto" school and ninety in 
a lower-middle class suburban school were randomly selected and 
assigned to three experimental treatment groups in each school. In each 
group a video-taped teacher instructed the students to perform three 
simple tasks. The verbal message was held constant while the nonverbal 
communication differed (positive, negative, neutral). Results indicated 
that productivity of the lower-middle class suburban subjects was not 
^Ifected by differences in nonverbal communication style, while ghetto 
children were more productive (p < .05) on a drawing task under 
negative conditions. While ghetto children showed no affect-style 
preference, suburban preferred positive, negative, neutral respectively. 

A Study of the Relationship of Global Self-Concept, Academic 
Self-Concept, and Academic Achievement Among Anglo and Mexican- 
American Sixth Grade Students 

THOMAS H. LINTON, Region One Education Service Center 

The purposes of the study were: (1) to determine if Anglo and 
Mexican-American sixth grade students differed significantly on 
measures of global self-concept and academic self-concept, and (2) to 
determine the relationship of academic achievement to global and 
academic self-concept. Data obtained from 159 Mexican-American and 
173 Anglo sixth grade students indicated that the two groups did not 
differ significantly either on global or academic self-concept. In 
addition, academic self-concept was more consistently related to 
achievement than global self-concept for both Anglo and Mexican- 
American students. 

Cross-Cultural Study on the Effect of Space on Teacher Controlling 
Behavior 

GAIL PERRY and ROBERT C. HARDY, University of Maryland 

This is a cross-cultural study using teachers in the Virgin Islands and 
Washington, D. C. concerning the effect of classroom space on teacher 
behavior. It is hypothesized that Head Start teachers in small 
classrooms will control children more than teachers in large rooms. 
Behavior of the twenty Virgin Island teachers in the largest and smallest 
Head Start classrooms was analyzed using an observation Control/Non- 
control Scale. An analysis of variance, used to analyze the data, 
supported the hypothesis that teachers in small classrooms were more 
controlling, employing more discipline, threats and restraints. This 
research has implications for facility planning and teacher guidance. 



SPELLING 

Student Ratings of Expected Performance in Spelling and Their 
Relation to Actual Performance under Several Assessment Conditions 

KAREN K. BLOCK and NANCY B. PESKOWITZ, Learning Research 
and Development Center 

Students judged a list of medium difficulty words via a numerical 
rating scale which reflected their expected spelling performance 



(Cannot (1); Maybe (2); Can (3)). Students heard the word and rated it; 
after rating all words, students spelled them with no feedback. After a 
short delay, they rated their spelling performance again either under 
similar conditions, or after reading their spellings. Judgments of 
expected performance were differential predictors of subsequent 
performance and might be used to select instructional treatments. 
Reading previous spellings improved the detection of incorrect spellings 
suggesting that reading and spelling should be treated as complementary 
tasks in the curriculum. 

Alternative Uses of Phonemic Information in Spelling 

DOROTHEA P. SIMON, HERBERT A. SIMON, Carnegie-Mellon 
University Learning Research and Development Center 

The paper distinguishes several different ways in which phonemic 
information can be employed in spelling, examines some empirical data 
on the consequences of using these different information sources, 
formulates hypotheses about the underlying processes, and draws 
implications for the teaching (and learning) of spelling. A computer 
program is constructed to simulate spelling processes that use phonemic 
information. The performance*, of the program is analyzed, and its 
behavior compared and contrasted with the rule-table algorithm of 
Hanna, et al. The program is shown to give a plausible account of the 
causes for children's most common spelling errors. 



The Effects of Word Segmentation Schemes on Spelling Acquisition 
and Retention 

SHIRLEY A. TUCKER and KAREN K. BLOCK, Learning Research 
and Development Center; PATRICIA A. BUTLER, Southwest Regional 
Laboratory for Educational Research and Development 

Students learned spelling words via three word segmentation 
schemes. Focal units (letter, pronounceable chunk, whole word) were 
either pronounced or not pronounced. Students learned two word 
types: words whose segments result in the common pronunciation (e.g., 
SPEC-TA-TOR) and words whose segments do not (e.g., WEDNES- 
DAY). Results showed the latter were more difficult. Teaching 
pronounceable chunks facilitated acquisition of both word types when 
segments were pronounced. Delayed and long term retention were low 
and unaffected by the experimental variables. The context for learning 
spelling should be broadened from phonological and orthographical 
dimensions to dimensions such as word meaning to enhance retention. 

The Von Restorff Effect on the Number and Distribution of Spelling 
Errors 

ALAINE F. JASS and WILLIAM B. GILLOOLY, Rutgers University 

The use of the von Restorff or isolation-by-color effect to reduce 
spelling errors predicted by Hanna, Hanna, Hodges, and Rudorf (1966) 
was investigated by training 64 5th graders with 30 eight-letter words. 
These words were irregular with respect to phoneme-grapheme corre- 
spondences. Overall error reduction was the same for both the 
isolation/ no isolation groups thereby agreeing with previous verbal 
learning studies that lists employing the isolation effect are not learned 
better than other lists. The distribution of errors across serial-letter 
positions, however, was significantly different, suggesting that atten- 
tional factors affect the serial position curve. 
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TEACHER BEHAVIOR 

The Influence of Opinions of Professional Reference Groups on 
Decisions of Pre-Service Teachers 

GEORGE W. BRIGHT, Northern Illinois University; L. RAY CARRY, 
The University of Texas, Austin 

Two hypotheses were tested on the population of pre-service 
secondary school mathematics teachers: 1) Mathematicians and 

educators influence decisions of such teachers in projected classroom 
situations. 2) Mathematicians exert more influence than educators. 
Projected classroom situations were written, each requiring resolution 
and each accompanied by three plausible alternatives. The sample was 
split randomly into control and experimental groups. X 2 statistics 
showed support for Hypothesis One (p < .001). Kolmogorov-Smirnov 
statistics indicated significant influences of mathematicians at the .03 
level and of educators at the .01 level. Wilcoxon signed-rank matched- 
pairs statistics indicated no significant differential effects. 

The Effects of Pupils' Race, Class, Test Scores, and Classroom Behavior 
on the Academic Expectancies of Southern and Non-Southern White 
Teachers 

BARBARA H. LONG, Goucher College; EDMUND H. HENDERSON, 
University of Virginia 

One hundred and twenty white elementary teachers (half Southern, 
half not) rated 12 descriptions of children which varied in readiness 
scores (3 levels), activity (active, passive) and attention (high, low) as to 
their likelihood of learning to read in first grade. Four forms which 
varied as to race (black, white) and class (middle, low) of the child were 
used with each group. Analysis of variance 13x2x2x2x2x2) 
showed main effects for scores, activity, and attention and six 
significant interactions. Findings suggest that teachers' expectancies are 
affected by pupils' behavior as well as scores and that scores, race, and 
behavior interact with teachers' background. 

Presentation Behavior Related to Success in Teaching 

ROBERT H. PINNEY, Western Washington State College 

This study was intended to identify correlates of successful teaching 
as might exist in the presentation behavior of pre-interns. Using 
twice-adjusted (student verbal/quantitative ability; difficulty of lesson) 
mean class achievement scores, 16 high-scoring and 16 low-scoring 
teachers were drawn from 56 Stanford social studies and English 
pre-interns. Four categories of presentation behavior, verbal, non- 
verbal, combinations, and interaction, yielded over 100 measures of 
behavior, coded via audiotape, videotape and manuscripts. Results 
indicate high-scoring teachers conveyed essential lesson points via 
frequent repetition, verbal statements of importance, and/or reinforce- 
ment of responses, often accompanied by various non-verbal behaviors. 

Conceptual Level as a Determinant of Teacher Behavior and Attitudes 
in a NonStructured Type Learning Activity 

RICHARD C. OSWALD and FRANK BROADBENT, Syracuse 
University 

Using the Conceptual System Theory as a theoretical rationale, this 
study yielded data which indicates that teacher conceptual level is a 
major determinant of teacher behavior and attitudes during a 
minimally-structured type learning activity. Evidence tends to support 
the conclusion that the low conceptual level teacher may re-structure a 
minimally-structured lesson in such a way that he can play the role of 
teacher as normatively defined by him; whereas the high conceptual 
level teacher tends to alter his behavior relative to the nature of the 
lesson employed. 



Stability of Teacher Effectiveness 

JERE E. BROPHY, University of Texas, Austin 

Data are presented on second- and third-grade teachers' consistency 
(stability) in producing residualized gains in the Metropolitan Achieve- 
ment Tests. Stability coefficients and data showing the percentages of 
teachers who meet various consistency criteria are given for: (a) boys' 
vs. girls' achievement; (b) achievement on the different subtests of the 
Metropolitan; (c) consistency across 3 years in effectiveness with each 
sex and for each Metropolitan subtest. The implications of these data 
for research and theory about effective teaching are discussed. 



TEACHER PERCEPTIONS AND ATTITUDES I 

Changing Teacher Attitudes Toward Human Relations Problems in 
Integrated Schools 

LEN T. SPERRY, Marquette University 

Some researchers consider it difficult to modify teacher attitudes 
concerning human relations problems because of the difficulty of 
dealing with both individual personalities and organizational roles. This 
paper reports the results of a pilot study in which the survey feedback 
method was employed in an urban elementary school to promote 
changes in the perceptions of white teachers toward their racially mixed 
students. After two months of the experimental treatment, the teachers 
in the experimental c^oup reported significant changes in their 
perceptions and attitudes toward their students. The immediate 
implications of this research for integrated schooling are discussed. 

A Study of Attitude Factors for Secondary School Teachers and 
Teacher Education Students 

JOHN EDWARD McCLURE and ROBERTS. BARCIKOWSKI, Ohio 
University 

The purpose of this study was to define teacher attitude factors for 
secondary teachers and teacher education students using an instrument 
made up primarily of attitude items which had been found to have high 
factor loadings in other studies and to assess the effects of male-female 
and teacher-undergarduate dichotomies on the stability of these factors. 
Using factor analysis techniques ten factors were defined and compared 
to factors found in other studies of teacher attitudes. Several of the 
factors defined in this study seem to have promise in the prediction of 
teaching success. 

' The Relationships Between Secondary School Teachers' Knowledge of 
and Attitude Toward Educational Research 

BYRL G. SHORT, Penfield Central Schools; MICHAEL SZABO, 
Pennsylvania State University 

This study was designed to assess the relationships among secondary 
school teachers': (1) knowledge of educational research terminology, 
and (2) attitude toward educational research. A knowledge of edu- 
cational research test (SKERT) and semantic differential attitude test 
were constructed. Additional data were secured through a question- 
naire. A sample of 204 secondary school teachers from western New 
York State voluntarily completed the self-report data forms. Scores on 
the SKERT were significantly related to: (1) subject matter taught, (2) 
recency of course work in statistics, measurement, and design, and (3) 
prior research experience; and were independent of attitude toward 
educational research. 
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Selected Attitudes and Perceptions of Beginning Teachers as Related to 
Their Teaching Situations 

P. TER RETT TEAGUE, JR., Stephens College 

The purpose of the study was to assess characteristics of beginning 
teachers' first year teaching situations and the effects upon these 
teachers across placements. Situations were delimited by size and type 
of community and racial composition of teachers' classes. Scales were 
used to elicit responses of University of Georgia education graduates 
regarding perceptions of situational characteristics, teacher-situation 
relationships, preparation for teaching, and attitudes toward education. 
Perceptions and attitudes of beginning teachers were significantly 
differentiated on several variables, including more favorable perceptions 
of adjustment and adequacy of preparation being indicated by teachers 
in suburban settings and with predominantly white classes. 

Teachers" Views of Particular Students and Their Behavior in the 
Classroom 

BARBARA B. JENKINS, University of Chicago 

The ways a teacher views her students were studied at three levels of 
generality: (a) her over-all attitudes toward particular students, (b) her 
generalized expectations, and (c) her perceptions of speciffc classroom 
behavior. The subjects were four attitude recipients and their teacher 
from ten suburban, intermediate level classrooms. The teachers were 
interviewed; the students' behavior was observed; and the teachers' 
perceptions were assessed by questionnaire. Two student behaviors, 
three teacher perceptions, and two generalized expectations separately 
were major determiners of the teachers' attitudes of attachment, 
rejection, concern, and indifference. The students' behaviors were only 
minor determiners of teachers' perceptions and expectations. 



TEACHER PERCEPTIONS AND ATTITUDES II 

Student-Directed Learning in an Undergraduate Course in Educational 
Psychology 

MELVIN L. SILBERMAN and JEROME S. ALLENDER, Temple 
University 

The purpose of this research was to evaluate a student-directed 
approach to a typical undergraduate course in educational psychology . 
Five experimental sections utilized student-directed, inquiry learning 
procedures and six control sections employed a more traditional, 
teacher-directed approach. Data was obtained concerning shifts in 
students' evaluative attitude toward the course as well as their 
conceptions of teaching. The experimental group had a significantly 
more positive evaluation of the course and reported greater impact 
from it than did control students. In contrast to the control group, they 
also underwent a significant change in their conceptions of teaching 
during the semester. 

Effects of Teacher Set 

EDMUND T. EMMER, University of Texas; THOMAS L. GOOD, 
University of Missouri; GENEVA HANNAH PILGRIM, University of 
Texas 

The effects of teacher set toward achievement or toward attitudes 
upon pupil achievement and attitudes were studied. Three groups of 
student teachers experimentally received, respectively, a set toward 
pupil achievement, toward pupil attitudes, or no set. The natural set of 
both student and teachers and their cooperating teachers was also 
assessed. Measures obtained in each of 58 classrooms included pre and 
post achievement tests, an attitude questionnaire, observations of 
teacher and pupil behavior, and ratings of student teacher journals. The 







student teabhers' natural set was significantly related to pupil attitudes. 
No treatment effect was found for the induced sets. 

Teacher Non-Verbal Activity 

BARBARA M. GRANT, William Paterson College of New Jersey 

This descriptive research study had as its major objective the 
development of a category system through which the teacher's physical 
motions in relation to his verbal actions could be analyzed with a high 
degree of reliability. The performances of five elementary teachers at 
the College Demonstration School were recorded on video tape. 
Narrative typescripts of both verbal and non-verbal “teacher motions" 
were made for representative, random samplings of lesson segments. 
Using the analysis system that emerged in this study, two teams of 
coders analyzed these data. Coefficients of agreement between teams 
ran consistently high. Hypotheses, concernim^non-verbal activity, were 
projected. 

Teacher Survival Behaviors within the School Organization 

ANNS. FERREN 

The purpose of the study was to determine how teachers adapt to 
the demands of the organization in which they teach. Data were 
gathered through semi-structured interviews and observation in two 
secondary schools. The major findings included: All teachers utilized 
adaptive behaviors in their daily work habits. The behaviors coincided 
in classification with those reported in industrial research. The 
behaviors included disassociating oneself from the teaching role, 
limiting persona! involvement, and goal displacement. If conflict and 
adapting are inevitable, behaviors which promote equilibrium with the 
least detriment to the organization, the teacher, and the students 
should be sought. 

The Persistence of First Impressions in Course and Instructor 
Evaluations 

R. BARKER BAUSELL and A. J. MAGOON, University of Delaware 

A course evaluation instrument was administered at the beginning 
and at the end of the course to 357 Ss enrolled in 20 undergraduate and 
graduate courses. Ratings changed notably on six items, and individual 
changes were in part predictable from expected grade changes. Pre-post 
correlations, however, for each of the 29 items (N = 20) yielded a 
median value of .67 as compared to a corrected split-half reliability of 
.78 for the posttest. Apparently, experiences with an instructor and 
course intervening between the beginning and end of a course have only 
a slight influence on student evaluation of the instructor. 



TEACHER-PUPIL INTERACTION 

Behavioral Responsiveness of Teachers in Verbal Interactions with 
Students 

PHILIP C. McKNIGHT, University of Kansas 

Two training procedures for promoting teacher responsiveness to 
student comments in small classroom groups were investigated. 
Responsiveness was defined as the ability to listen carefully to what 
students say and to respond in an appropriate cognitive and affective 
manner. Results indicated that a procedure emphasizing listening 
training improves teachers' abilities to summarize and retain the 
content of verbal communications as measured by a post-training test. 
“Response appropriateness" training did not have a significant effect on 
a post-training test, although a control group showed least improve- 
ment. The effects of the training procedures on post-training discus- 
sions were not generally significant. 
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An Observational Investigation of Instruction and Behavior in an 
Informal British Infant School 

RICHARD M. BRANDT, University of Virginia 

The purpose of this investigation was to gather a comprehensive 
assortment of objective descriptive data on an informal British infant 
school in an effort to understand rather precisely the nature of 
instructional processes and pupil experiences. The principal method of 
obtaining data was observation and the making of PROSE records on a 
stratified random sample of young children in two classrooms. 
Instructional processes were characterized by a high rate of teacher and 
pupil behavior, considerable pupil involvement in a wide range of 
self-selected activities, reinforcement of certain teacher expectancies, 
and frequent questioning of pupils about their activities and expe- 
riences. 

The Effects of an In-Service Training Program for Elementary Teachers 
Upon Selected Teacher-Pupil Perceptions and Relationships 

DAVID P. GABEHART, RONALD IANNONE, JOHN L. CARLINE, 
and C. KENNETH MURRAY, West Virginia University 

The purpose of this study was to determine the effects of an 
intensive in-service training program designed to develop a positive 
social-emotional classroom climate upon selected teacher-pupil percep- 
tions and relationships. Thirty teachers were given pre and post tests on 
Barrett-Lennard's Relationship Inventory and the Dogmatism Scale; 
four hundred and seventy five pupils were given the Relationship 
Inventory, Tuckman's SPOT'S, and Coppersmith's Self-Esteem Inven- 
tory. A t-test was applied to test the differences between the 
experimental and control group of teachers and their pupils. The results 
indicate that the objectives of the in-service program were met. 

Freedom and Fairness: A Comparison of Male and Female Teachers in 
Elementary Classrooms 

HENRIETTE M. LAHADERNE and SARALE COHEN, Institute for 
Development of Educational Activities, Inc. 

The proposition that male teachers create more flexible classroom 
settings, grade more fairly, and have greater success with boys than do 
women was explored through classroom observation, teacher interviews 
and ratings, and pupil questionnaires. The comparison of 14 male and 
39 female elementary school teachers showed few differences in the 
classroom environment; moreover, these differences favored the 
women. There was no effect of teacher's sex on the ratings assigned to 
boys and girls. Pupils with female teachers had higher science 
achievement test scores, knew more about the school environment, and 
held a more positive attitude toward school than did pupils with male 
teachers. 

Modification of the Verbal Behavior of Teachers: Its Impact on the 
Verbal Behavior of Pupils 

ROBERT F. TARDIF, California Department of Education 

Twelve teachers were randomly assigned to two equal groups. Six 
received specialized training for analyzing videotape recordings of their 
own in-class verbal behavior according to its potential impact on pupil 
thinking. Six received no training and they, and their classes, 
constituted the control condition. Both groups were videotaped equally 
often and the first and last tapes were used to generate data for the 
MANOVA hypothesis testing. The verbal behavior of both teachers and 
pupils was significantly different between groups due to treatment. 
Between groups pupil differences on selected critical thinking skills 
were not significant before or after treatment. 



TEACHER RATINGS 

Validity of Tests of the Cognitive Processes 

I. LEON SMITH, Yeshiva University 

Based on the assumptions of the Taxonomy and its definitions of 
the cognitive processes, it was hypothesized that performance on the 
first four levels favors students from a conventional educational 
environment, while tests of the upper two levels favor those from a 
more open climate. Male and female students from two classes at each 
of two grades from both environments were administered the Lorge- 
Thorndike intelligence Test and a taxonomic test. Data were analyzed 
through multivariate analysis of co-variance procedures. Results support 
the hypotheses. Implications are discussed in refation to the cognitive 
processes and the goals of education. 

Teacher Accountability and Pupil Achievement in Reading 

HOWARD J. SULLIVAN, Arizona State University; FRED C. 
NIEDERMEYER, Southwest Regional Laboratory for Educational 
Research and Development 

This year-long, 15-school study investigated the effect of teacher 
accountability on reading achievement of first-grade pupils. Four levels 
of accountability were defined as follows: (1) use of regular reading 
program only, (2) regular program plus instructional objectives, an 
assessment exercise, remedial exercises, and objectives-keyed pupil 
performance records for each unit, (3) condition 2 above plus either a 
pacing schedule or reporting of unit scores to the school principal, (4) 
condition 2 plus both pacing and reporting. A 4x3 L-test revealed a 
significant positive relationship (p<.001) between level of teacher 
accountability and end-of-year pupil achievement. 

The Effectiveness of a Performance-Based Teacher Training Module on 
Planning and Presenting 

JEFF A. PYATTE, University of West Florida 

Small, efficient learning packages designed to teach specific informa- 
tion, skills or concepts are becoming a large part of instructional 
programs in teacher training institutions. Measuring the effectiveness of 
these packages is a difficult problem. Results of effectiveness studies on 
a performance-based module used with classes of inservice and 
preservice teachers are disclosed in this paper. The evaluation design 
employed is a Simple Single Criterion Evaluation Design used by the 
Navy in effectiveness studies of training materials in programmed 
format. A mean of correct responses of eighty percent indicated that 
the module was effective and students received the material enthusiasti- 
cally. 

Teacher Evaluation as a Function of Students' Sex and Achievement 
Level 

M.Y. QUERESHI, Marquette University; FREDERICK W. WIDLAK, 
Purdue University 

Sixty-seven male and 73 female undergraduates rated self, father, 
mother, and a male teacher on MARS. They also rated the teacher on a 
17-item scale {RST) at the end of the course and took five 
teacher-made achievement tests during the semester. Students were 
divided into high and low achievement levels (AL), using the median as 
the cutoff. Two-way multivariate analysis of variance showed signif- 
icant (p<.0001) differences in teacher ratings on MARS and RST 
factors between the sexes and between high and low AL Ss (p < .05). 
Also, a significant Sex X AL interaction (p < .05) was found for RST 
data. 
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The Relationship of Selected Student Characteristics to Components of 
Teacher/Course Evaluations among Freshman English Students at Kent 
State University 

W. ROBERT KENNEDY, Kent State University 

This study investigated the relationship of selected student variables 
and four evaluative components of a teacher/ course evaluation instru- 
ment using as a sample 549 freshmen students enrolled in English 160 
at Kent State University during Fall Quarter, 1970. Students' age, 
selected Omnibus Personality Inventory subscale scores, and American 
College Test scores were not correlated with their ratings on each of the 
evaluative components. Fall Quarter grade point average, "actual" and 
"actual versus expected" grade in the course were positively correlated 
with all component ratings. Sex and college membership were relate* to 
ratings on one or more of the evaluative scales. 



TEACHER TRAINING I 

Patterns and Styles in the Supervision of Teachers in Individual 
Conferences Following Classroom Observations 

ESTHER THEODOR and ARYE PERLBERG, Technion, Israel 
Institute of Technology 

Goldhammer's model for studying the content of supervisory 
conferences was the basis for a qualitative analysis of 25 conferences, 
held between five supervisors working in culturally deprived schools 
and five teachers who taught five micro-lessons, which were supervised 
independently by each of the five supervisors. Analysis of the taped 
conferences revealed that although many supervisory patterns were 
common to the supervisors, each had a unique style consisting of 
specific combinations of patterns. The participating teachers and fifteen 
other teachers, who listened to the taped conferences, were in 
substantial agreement (r = -77) on preferred and rejected patterns and 
styles of supervision. 

Public School Experience and its Impact on Pre-Service Education 
Students 

GOLAM MANNAN and LEWIS M. CIMINILLO, Indiana University, 
Northwest 

The objective of the study was to explore the cognitive and 
attitudinal changes of sophomore and junior students taking their first 
course in education. The focus was on subject matter gain and 
attitudinal change. The students were divided into two groups, half 
receiving part of their schooling on site in the public schools; the other 
half in a conventional university setting. Pre and post tests were given. 
While no significant differences were found in knowledge gained in 
either group, the group assigned to the public schools exhibited 
considerable change in attitude. 

The California Teacher Development Project for Individualized 
Instruction: Individualizing Inservice Education 

W. WARREN KALLENBACH and DENNIS CARMICHAEL, San Jose 
State College 

The California Teacher Development Project for Systems of 
Individualized Instruction is an ESEA Title III Project designed to 
facilitate teacher and administrator role transitions from group-paced to 
individualized instruction. Teachers in the Experimental Group 
(N-61), when compared to a comparable Control Group, were 
determined to increase significantly (p<.001) in positive teaching 
behaviors following participation in a five-day individualized workshop 
on individualizing instruction. All teacher's classrooms were observed 
once before and twice following the workshop. Attitudes and knowl- 



edge were assessed for students of teachers in both groups. Results 
moderately favored students in non-Experimental Group classrooms. 

The Effects of Training on Increased Use of and Correlation Between 
Higher Order Classroom and Test Questioning Behavior 

JOHN L. DERHAMMER, Georgia State University, Columbus; 
WILLIAM H. CORMIER, The University of Tennessee 

The controlled study investigated the effects of training, with and 
without feedback, on increasing teachers' higher order classroom and 
test questions and improving the correlation between these two kinds 
of questioning behavior. A Questions Analyzer was used to obtain the 
data from twelve elementary school teachers in Tennessee. Classroom 
and test questioning behavior were analyzed using analysis of variance 
and coefficient of correlations. Results indicated that training 
significantly increased the incidence of, and correlation between, higher 
order classroom and test questioning behavior in both trained groups. 
The findings emphasize the importance of training teachers in the use 
of higher order questions. 

The Relationship Between Satisfaction and Performance in Student 
Teaching 

BERNARD J. SHAPIRO, Boston University; PHYLLIS P. SHAPIRO, 
Emmanuel College 

This study represents an exploration of the relationship between 
student teacher satisfaction with the classroom internship and the 
assessment of that internship by the master teacher. Using 50 teacher 
education seniors as subjects, it was found that the greatest satisfaction 
was being expressed by students toward the middle of the grade range 
while much lower satisfaction levels were characteristic of interns seen 
as either "outstanding" or "unsatisfactory" by their master teachers. 
However, item analyses revealed that although the general level of 
dissatisfaction of these two groups was the same, the underlying reasons 
for their discomfort were quite different. 



TEACHER TRAINING II 

Preaching and Practice in Teaching Educational Psychology: A 
Four-Year Study 

CHARLES G. GALLOWAY, University of Victoria 

The purpose of this study has been an attempt to individualize 
instruction within an introductory course of educational psychology. 
The material has been programmed so that through a learning-for- 
mastery approach ideas being "learned-about" are reflected in how the 
material is taught. Average student performance has increased each 
year. Over 90% of the students complete all the work required. Student 
evaluations have been consistently positive toward learning-for-mastery. 
Follow-up information over two years comparing the opinions of 
students now teaching who experienced the individualized approach 
and students who did not indicates relatively higher ratings for the 
transfer value of the individualized approach. 

Incidental Learning of Curriculum Subject Matter in Educational 
Psychology Courses 

EDWARD LE DERM AN, Eastern Michigan University 

Students in an educational psychology course examined the test 
blueprint and objective items from an educational achievement test. 
The students saw the answers to the items but they were not explicitly 
told to learn them. These students scored higher on the items than a 
control group, but the point-biserial correlation between group 
membership and scores was not hi<#i. Only a small amount of incidental 
learning occurred, when a large amount would have been desirable. 
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Program Priorities in Teacher Education 

CAROL KEHR TITTLE, City University of New York 

The Committee on National Program Priorities in Teacher Educa- 
tion was formed to make recommendations to USOE-BEPD and Task 
Force '72 for program development. Committee members prepared 
plans, and abstracts were circulated to reviewers (70 individuals 
representing universities, schools, critics of education, etc.; 38 (54%) 
returned comments). Major ideas were presented as items to be rated. 
These ratings were used by the Committee, but are of more general 
interest in indicating the importance of proposed developments, and 
highlighting conflicting views about appropriate criterion levels for 
accountability (teacher performance versus pupil change) and 
approaches to teacher education ("technological" versus "humanistic"). 

Tests of Teacher Concerns Model Hypotheses 

FRANCES F. FULLER and JANE S. PARSONS, University of Texas, 
Austin 

Concerns Statements produced three factors: I Role Entry, II Self 
vs. Pupil, and III Teacher Teaching vs. Teacher Learning. Comparisons 
of scores of inservice and pre^ervice teachers supported both the 
sequential and maturational hypotheses of the Teacher Concerns Model 
(Fuller, 1969). I nservice teachers had more concerns about pupils while 
preservice teachers had more concerns about themselves. Inservice 
teachers rated more effective had higher concerns than those rated 
ineffective. Concerns were stable over short time periods and advanced 
over preparation in most groups, but sources and patterns of change 
seem complex. 

A Study of Some Preservice Student Teacher Characteristics and Their 
Correlation with Shift in Teaching Concerns 

HEATHER L. CARTER, University of Texas, Austin 

Preservice elementary teachers formed the population for this 
investigation. Hypotheses correlating concerns with respect to teaching 
and specified student characteristics were tested. One objective of the 
treatment program was to change the students' concerns. Following 
treatment, a positive significant correlation was found between student 
characteristics and concerns of students. Similar correlations were not 
observed before the treatment nor between students possessing the 
same characteristics and their concerns after traditional teacher 
programs. The findings suggest that the treatment was effective in 
producing a change in concerns and indicate certain predictor character- 
istics for teaching success as defined by more mature concerns. 



VERBAL LEARNING I 

Elaboration and Learning Efficiency in Pour Ethnic Groups 

DANIEL W. KEE and WILLIAM D. ROHWER, JR., University of 
California, Berkeley 

Paired-associate learning efficiency was assessed within four low-SES 
ethnic populations (black, Chinese, latin, and white) as a function of 
presentation mode and method of measurement (verbal recall vs. 
pictorial recognition). A mixed-list paired-associate task was admin- 
istered individually to forty second grade children from each group. 
The results revealed no population differences, nor any interactions 
with presentation mode or measurement method. For all groups, 
performance was substantially facilitated by both elaborated modes of 
presentation and by the recognition method. 



Paired-Associate Learning as a Function of Mediational Set in EMR and 
Nonretarded Children 

DONALD L. MacMILLAN, University of California, Riverside 

Three methods of presenting paired-associates to EMR and non- 
retarded children were compared. Two measures were taken on initial 
learning and two on generalization. Control Ss simply named the 
objects; Explicit-mediation Ss were provided with a specific sentence 
mediating the two objects; and Self-generated Ss were instructed to 
generate their own sentences. All groups learned two lists under the 
above conditions and then a third list in which no set was established. 
Explicit and Self-generated conditions both appear to be superior for 
EMR and nonretarded children. 

Antonym Adjective Contexts and the Facilitation of Noun Pair 
Learning 

LINNEA C. EHRI and DANA L. RICHARDSON, University of 
California, Davis 

A noun-pair learning experiment was designed to contrast imagistic 
and linguistic accounts of verbal facilitation and to examine recall 
patterns in children thought to differ in the tendency to process 
information ikonically or symbolically. Second and sixth graders 
(N = 160) were asked to learn 16 noun pairs linked by either verbs, 
antonym adjectives, or conjunctions. Results revealed that for both 
grade levels, adjective contexts, which aroused attribute rather than 
interacting image relations between nouns, facilitated as much learning 
as verb contexts. These results suggest that the arousal of overlapping 
images is not necessary for maximal facilitation in either second or 
sixth graders. 

A Developmental Study of Imagery Instructions on Noun-Pair Learning 

JOHN E. EOFF and WILLIAM D. ROHWER, JR., University of 
California, Berkeley 

A three-way design was used to assess the effect of imagery 
instructions on noun-pair learning. The three principal factors were: 
Instructions (imagery vs. rehearsal vs. control); Presentation Mode 
(words vs. pictures); and. Grade (1, 3, 6 and 11). Sixty subjects were 
drawn from each Grade and randomly assigned to the six conditions. 
Analysis revealed significant main effects for Grades (favoring older 
subjects) and Mode (favoring pictures) but no interaction. In the word 
mode. Imagery instructions were effective only in the sixth- and 
eleventh-grade samples whereas in the picture mode they facilitated 
performance in the third-grade samples as well. 

The Effect of Subject Generated Strings on Noun Pair Recall: 
Population Comparisons 

JOAN P. BEAN, University of Massachusetts 

Children from Low-SES-Black and High-SES-White populations 
learn concrete noun pairs more efficiently when nouns are embedded in 
subject generated and experimenter provided verba! contexts than in 
no-context controls. The focus was on the population source of verbal 
contexts (Black or White) and the effect on learning within and 
between populations. Two-hundred sixteen, 6th graders were aurally 
administered 36 pairs of concrete nouns. The results indicated that 
linguistic strings generated by Low-SES-Black Ss facilitate noun pair 
learning for Ss like them, High-SES-White Ss performance was 
facilitated by all strings generated. 






VERBAL LEARNING II 

Organizational Processes in the Free Recall of Sentences 

THOMAS ANDRE, State University of New York, Cortland 

The present study investigated clustering of categorizable sentence 
lists. Sentence voice and presence or absence of modifying adjectives 
were manipulated. The hypotheses were that clustering would be 
greater when the categorizable elements were emphasized by the 
sentence structure than when they were not, and that unmodified 
sentences would show greater clustering than modified sentences. 
Preliminary results indicate that the hypotheses were confirmed. The 
implications of the results for psychological theory and educational 
practice were discussed. 

The Effects of Verbal, Imaginal, and Rote Instructional Sets on the 
Learning of Concrete and Abstract Sentences 

DONALD J. CUNNINGHAM, Indiana University 

Thirty Ss learned 10 concrete (high rated imagery) and 10 abstract 
sentences (low rated imagery) under one of three (N = 10) instructional 
sets: imagery, verbal, and rote. Analyses were conducted on the 
proportion of concrete and abstract sentence verbs, predicate adjec- 
tives, and predicate nouns recalled at two levels of strictness in scoring. 
Concrete sentence elements were recalled better than abstract sentence 
elements. Imagery instructions facilitated the recall of both concrete 
and abstract sentence nouns and concrete sentence adjectives while 
verbal instructions seemed to have their primary effect on sentence 
verbs and abstract sentence adjectives. Implications for reading research 
are discussed. 

Effects of Massed vs. Distributed Practice and Word Frequency on 
Young Children's Free Recall 

ROBERT L. HOHN, University of Kansas 

Forty kindergarten children were randomly divided into High 
Frequency word (Thorndike-Lorge) and Low Frequency word groups 
and were each presented a 32-word list in a free recall setting. Words 
were varied under conditions of massed or distributed practice and one, 
two, three or four repetitions. Frequency of word occurrence did not 
affect performance, but both greater repetition, and distributed 
practice led to greater recall. Results reject the notion that novelty of 
words to be learned affects recall and supports the finding that 
distributed practice enhances young children's free recall. 

Effect of Recency on Word Choice In a Sentence Completion Task 

DONALD T. MIZOKAWA and DONALD J. CUNNINGHAM, Indiana 
University 

This experiment attempted to demonstrate that recent experience 
affects word choice in language production. The Ss were given recency 
training, two groups (N = 17 each) with equivalent lists of words, and a 
third group (N =15) with a dummy list. The Ss rated the words 
according to difficulty of imaging the referents. All Ss then began the 
experimental task, introduced as a separate experiment. The Ss 
completed 35 sentences (20 could be completed by words from the 
recency list; 15 were distractors). Significantly more recency than 
non-recency words occurred in one of the experimental groups, 
compared with the control group. 

Absence of Priority of Free Recall of Newly Learned Items in Preschool 
Children 

MURRAY A. NEWMAN, LEON P. EDMONSTON and NORVELL W. 
NO RTHCUTT, Southwest Educational Development Laboratory 

The two experiments reported in this study demonstrated that, in 
contrast to Steinmetz and Battig's (1969) data, preschool children do 



not display PRNI in either conventional FRL or in FRL where serial 
position bias is controlled. This finding, coupled with Battig and 
Slaybaugh's (1969) report of PRNI in FRL of adults, strongly suggests 
a developmental strategy interpretation of PRNI which emphasizes that 
the strategy is in part due to exposure to experiences (e.g., school) 
encouraging its use. 



VERBAL LEARNING III 

The Effects of Overt Verbalization on the Transfer of an Elaboration 
Strategy 

SUSAN E. WHITELY and ARTHUR M. TAYLOR, University of 
Minnesota 

After imagery training in generating elaborative contexts, EMR 
children learntd two paired-associate lists under four treatment 
conditions varying as to verbalization of the elaborative context 
permitted. It was found that verbalization facilitated recall on both 
lists, and that a group which was permitted to verbalize on only the 
first list performed equivalently to a group which verbalized on both 
lists. It was concluded that conditions which do not permit verbaliza- 
tions lead to efficient utilization of imagery training only if the EMR 
child has had previous experience with verbalization. 

Imagery and Verbal Elaboration, Incidental Context, and the Recall of 
inner City Children 

HENRY W. TAXIS and ARTHUR M. TAYLOR, University of 
Minnesota 

This study compares the effects on recall of five methods of training 
fifth-grade inner city children to construct elaborative relations. It was 
hypothesized and demonstrated that: a) imagery training resulted in 
greater recall and more organization than training to verbally elaborate, 
b) training to combine imagery and verbal elaboration facilitated recall 
as compared to verbal elaboration training alone, and c) incidental 
verbal context further facilitated imagery elaboration, while incidental 
pictorial contexts resulted in substantial interference with verbal 
elaboration. Implications are made concerning the teaching of reading 
and procedures for classroom training in constructing elaborative 
contexts. 

Variations of Strategy Pre-Training for a Strategy Based Approach for 
Teaching Retarded Children in the United States 

NILA BENDER, ARTHUR M. TAYLOR, R. HUNT RIEGEL, and 
JAMES E. TURNURE, University of Minnesota 

The objective was to show that when pupils' pre-training, teachers' 
approach, and materials maximize a grouping strategy, the pupils' 
post-test performance is enhanced. Three pre-training conditions were 
used: grouping, imagery-rehearsal, and control. Sixty junior high EMR 
pupils completed a workbook sequence on the central states. Results 
showed grouping pre-training resulted in significantly superior recogni- 
tion of arrays. Pupils showed a significant improvement in recognizing 
and labeling states on the post-test, but grouping Dre-training didn't 
show significant transfer on the post-test. It was concluded the transfer 
sought requires an awareness of using strategies. 

Measuring Children's Organizational Strategies by Sampling Overt 
Groupings 

R. HUNT RIEGEL, University of Minnesota 

Based on developmental research and on recent research on 
receptive and reconstructive strategies in children, a sequence of 
strategy-based activities was presented by classroom teachers. The 




objective of this sequence was to improve the child's ability to adapt to 
new stimulus conditions in more efficient ways. In addition, an 
instrument was designed to assess the organizational strategies most 
likely to be employed on new materials by EMR children. The 
instrument seems to accurately diagnose conceptual difficulties and to 
indicate appropriate access points into a training sequence. Validation 
of both instrument and instructional sequence appears promising. 



VISUAL PERCEPTION 

Aesthetic Judgments of Visual Stimuli as a Function of Stimulus 
Complexity and Color Mediated Arousal 

MINA B. GHATTAS, Northeastern University; FRANK H. FARLEY, 
University of Wisconsin 

In a study of aesthetic ratings of polygons as a function of visual 
complexity and color mediated arousal, a 2 x 3 x 22 design was used, 
consisting of black polygons on red versus white background, interest- 
ingness versus pleasingness versus subjective complexity ratings, and 22 
levels of (objective) polygon complexity (repeated measure). 48 
undergraduate females served as Ss, with 8 per cell. Although no 
significant main nor interaction effects were found on background 
color, ratings of interestingness, pleasingness and subjective ^complexity 
varied significantly as a function of objective complexity. Relevance to 
experimental aesthetics, media research and instruction was considered. 

Sequential Letter and Word Recognition in Deaf and Hearing Subjects 

RICHARD D. ZAK1A, Rochester Institute of Technology; RALPH N. 
HABER, University of Rochester 

Deaf and hearing college students were tested on their ability to 
process visual-verbal information presented in a time sequence. The 
deaf did better in naming words while the hearing did better in naming 
letters when nonsense words were sent. Performance for both groups 
drops as word length and speed of presentation increases, and as word 
imagery decreases. For deaf students there was a high positive 
correlation between their ability to name finger-spelled words and 
computer-spelled words. 

Differential Cognitive Cues in Pictorial Depth Perception 

ISSA M. OMARI and HAROLD COOK, Teachers College, Columbia 
University 

Forty predominantly black third grade children were randomly 
assigned to 8 groups and were asked a question regarding the 
relationship of objects in a pictorial depth perception task. The 
question varied in terms of "which (looks/is), (nearer/farther) to 
(you/man), the elephant or the antelope?" Performance in terms of the 
ability to perceive depth was statistically significantly higher when the 
Ss were asked "which looks/is farther .... rather than nearer No 
other effects were significant. The results suggest that the concept 
farther may provoke the Ss to attend to the size-distance inverse 
relationships. 

Recognition Memory of Words and Pictures in Adults 

KENNETH A. JACOBUS and R. PAUL STRATTON, University of 
Kentucky; S. DAVID LEONARD and DAVID CORSINI, University of 
Georgia 

A previous study by the authors indicated that preschoolers' 
recognition memory of pictures was superior to their recognition 
memory of aural words. The present study indicated a similar result for 
adults. However, the ratio of picture/aural word errors (misses) was 
smaller in the present study than in the previous study. These results 
supported Bruner's theory of cognitive development. 



Teaching Children to Discriminate Letters of the Alphabet through 
Errorless Discrimination Training 

BYRON EGELAND, Syracuse University; KENNETH WINER, 
Harford-Cecil Schools 

Two groups of 16 inner city preschool children were taught to 
discriminate two of four possible pairs of alphabet letters using an 
errorless discrimination training approach. Two similar groups were 
taught to discriminate the same letters using the typical classroom and 
laboratory reinforcement-extinction approach. For the errorless 
training group the distinctive feature of the letter to be discriminated 
was highlighted in red and as training proceeded the red was gradually 
faded. The results indicated that the errorless training group made 
significantly fewer errors during training and on the posttest trials 
compared to the reinforcement-extinction group. 



SYMPOSIA 

DEVELOPMENT OF AN ADVANCED COMPUTER-BASED 
INSTRUCTIONAL SYSTEM 

DUNCAN N. HANSEN, Florida State University, ORGANIZER 

In a planned effort to improve the effectiveness of Air Force 
training systems via computer and related instructional technology, the 
Air Force Human Resources Laboratory (AFHRL) recently set forth as 
a major objective the development, demonstration, evaluation, and 
dissemination of an Advanced Instructional System (A1S). 

The major goal can be stated as follows: AIS will demonstrate that a 
computer-based multi-media training system can provide significant 
cost-effective improvements in the operation of training courses within 
the Air Force's Air Training Command (A TCK 

Identified subgoals can be listed as follows: 1) AIS will provide 
applications of the latest training technology and instructional media in 
order to achieve full individualization of the training process; 2) AIS 
will primarily focus on the managerial processes offered by the 
computer; 3) the application of the most cost-effective multi-media 
approaches to training will be employed for both improved learning 
outcomes as weil as potential cost savings; and 4) AIS will be modular 
and flexible in that it will expand naturally from the current ATC 
training system for three prototype courses and become effectively 
integrated into the recruitment and training process for the total Air 
Force. The prototype r:.- Jementation of AIS at Lowry Air Force Base, 
Colorado, will ultimately grow into a network resource having the 
capability of supporting training systems throughout the United States. 

This symposium will discuss the history, development, and implica- 
tions of the computer-based AIS within both the military and civilian 
sectors. The AIS concept underwent a feasibility analysis conducted by 
Westing house Learning Corporation which was completed in August of 
1970. Design specification of the entire AIS will have been completed 
by January of 1972. These specifications are unique in the educational 
and training world in that the state-of-the-art hardware, media, and 
software technology will be integrated with proven management 
techniques and personnel configurations in a comprehensive system 
which will optimize student learning as well as provide for efficient 
administration of instruction. Additionally, the AIS specification makes 
provision for extending the state-of-the-art through research innova- 
tions which will provide increased system flexibility and growth. 

Proposed participants in the symposium represent multiple 
perspectives within the educational and training world as related to AIS 
development. Speakers represent the Air Force, the AIS specification 
contractor, the National Science Foundation, and the Office of Naval 
Research. ' ' 
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Dr. Marty Rockway and Mr. Joseph Yasutake represent the Air 
Force Human Resources Laboratory (AFHRL) at Lowry AFB, which 
serves as the project monitoring office. Dr. Rockway's presentation. 
The Origins of AIS, will relate to the genesis of the AIS, and will 
further relate to the explication of AIS goals as envisioned by the Air 
Force. 

Concurrently with the specification effort, three additional AIS- 
related contracts were awarded for development of individualized 
self-paced instructional materials for the three existent courses. A 
fourth award was made for the design of multi-media learning carrels. 
Mr. Yasutake's presentation. Management of a Multi-Phased Research 
Project, will focus on the relationships between these four AIS 
contracts and the specification effort. 

The civilian contractor for the development of AIS design specifica- 
tions was designated as the Florida State University's Center for 
Computer-Assisted Instruction. Representing this organization will be 
Dr. Duncan Hansen, Mr. David Thomas, and Mr. Dewey Kribs. Dr. 
Hansen's presentation. Planning a Computer Based Learning System, 
will focus on a review of the AIS specification process, a summary of 
each of the major subsystems required, and an evaluation of the 
substantive issues which were identified during the design specification 
effort. 

The nature of the AIS system as designed will be discussed by Mr. 
Thomas and Mr. Kribs. Mr. Thomas will describe the instructional and 
media subsystems as they were designed to provide for computer 
testing, CAI, adaptive training algorithms, resource scheduling, instruc- 
tional materials generation, and media selection and production. His 
paper is titled Instructional Strategies for AIS. The management and 
computer subsystems will be described by Mr. Kribs in his paper. 
System Design and Operation for AIS. The management and computer 
consist of language and operating environments for CAI and CMI, 
random access data files, scheduling routines, progress and status 
monitoring routines, a data analysis package, common language 
compilers, and an application program for providing systems effective- 
ness information from continuously collected usage data. The computer 
subsystem will be modular and assure upward compatibility with 
evolving hardware. Rapid recovery from system failure is a major 
requirement. 

A panoramic view and critique of the importance of a compre- 
hensive computer-based instructional system in general, and AIS in 
particular will be given by the discussants, Drs. Victor Fields and 
Andrew Molnar. Dr. Fields is Head of Personnel Training at the Office 
of Naval Research. His critique will focus on the present and future 
requirements within the military for large scale instructional systems 
which provide for individualized technical training. He will stress the 
currently existing problems which relate to large trainee flow require- 
ments, the role of individual differences, and the requirement for 
continual revision due to technological change. 

Dr. Moinar's presentation will draw on his broad experience as 
special projects officer for computer applications in education within 
the National Science Foundation. His critique will provide a statement 
of the importance of computer-based instructional systems to 
individualized instruction as well as a scenario of the potential impact 
of the AIS on American educational practice. 

The presenters and discussants represent many aspects of instruc- 
tional systems development related to the project being discussed. The 
AIS implementation is potentially the most far-reaching development in 
educational practice in two decades. Researchers have developed 
innovations along many dimensions: individualized instruction, com- 
puter technology, management techniques, instructional media devices, 
and other developments within education and the sciences. Never 
before has a single system been designed and implemented specifically 
for instruction and training on such a large scale incorporating all 
aspects of state-of-the-art technology while providing for future 
research innovations. The symposium's educational importance lies in 
informing the research community of this project so that potential 
users of this and similar computer-based systems may follow its 
continual development. 



INTERFERENCE AND THE FORGETTING OF PROSE 

THOMAS ANDRE, State University of New York, Cortland; 
RAYMOND W. KULHAVY, Arizona State University, ORGANIZERS 

The adequacy of interference theory as an explanation for the 
forgetting of material learned by reading has been a controversial issue 
in educational research. This symposium focused on an examination of 
the various theoretical positions in the Ifoht of the growing body of 
research on interference in prose. The individual presentations critically 
examined the literature in order to determine those variables which 
control the process of forgetting and which future research might 
profitably explore. In addition theoretical and educational implications 
of the research were suggested. Following the individual presentations, 
two discussants presented critical analyses of the papers and attempted 
to highlight the important issues raised. Finally the audience was 
invited to address comments and questions to the participants and 
discussants. 

"Retro- and Proactive inhibition Following-a Change in Context 
Using Meaningful Prose" was presented by Larry Jensen of Brigham 
Young University. The variable of changed context has important 
implications for a theory of the forgetting of meaningful prose. It was 
predicted that retroactive and proactive inhibition could be produced 
using meaningful passages of prose. In addition, it was hypothesized 
that if the interference session took place in a context which was 
markedly different from the room used during learning, the amount of 
retro- and proactive inhibition would be less. Also, if there was a 
contextual change between the learning and the recall session, retention 
would be less. A passage describing Jim as an extrovert was presented, 
and one describing him as an introvert. A classroom and cafeteria served 
as contrasting contexts. The hypotheses were confirmed. Theoretical 
implications of these findings were discussed. 

"The Similarity Variable and Retroactive Interference Effects" was 
presented by Jacqueline Haveman of Boston College. The conceptual 
nature of the similarity variable as it exists between prose materials 
used in retroactive interference studies has been little explored. Most 
researchers have developed materials that were judged to be similar 
through some form of logical or rational analysis and their empirical 
findings have been inconsistent. Consideration of the importance of 
psychological as well as logical similarity may reduce this conflict. A 
theoretical model was proposed that incorporates aspects of similarity 
and adds to generalizability between studies. Analysis of this variable is 
necessary before application can be made to the classroom. 

"New Directions in the Study of Retroactive Interference in Prose 
Learning" was the topic of Dennis L. Anderson of Carleton College. 
Researchers who have attempted to investigate retroactive interference 
in prose learning have been confronted with a number of theoretical 
issues. Among these are the controversy related to rote versus 
meaningful learning and whether or not models used in traditional 
verbal learning studies are appropriate for studying the retention t>f 
prose material. In order to deal more adequately with these issues it 
may be necessary to develop new models for investigating the retention 
of meaningful materials. A model based upon the use of set relations 
was presented as a possible approach. The relevance of this type of 
research for classroom learning was also discussed. 

"Variables Affecting Interference in Meaningful Verbal Learning" 
was the topic of Martin R. Wong of the University of South Florida. 
The literature covering the study of interference effects in meaningful 
verbal learning is replete with contradictory findings. The most obvious 
explanation for their contradictory findings is the lack of control in 
studies reported. One source of variation is the many interpretations of 
what is meant by meaningful verbal learning. An attempt was made to 
clarify the apparent cocophonous state of the research results by 
reviewing them through a gride differentiating the kind of "meaningful 
material" used, poetry prose under normal classroom study conditions; 
prose under lab conditions; connected discourse; disconnected words. 
Other variables were also looked at. Initial results indicate a clarifica- 
tion. 





"An Information-Processing Model of Memory and Forgetting" was 
presented by Thomas Andre, State University of New York, Cortland. 
Examination of the research literature on mechanisms of forgetting 
suggested that neither interference theory nor meaningful learning 
theory are adequate to explain the data on forgetting. An information 
processing model of memory and forgetting, that seems to provide a 
better fit to the data, was outlined. Two of the major components of 
the mode! are the computation of storage locations based on the 
characteristics of the input and the search of a constant amount of 
storage at the time of output. The model was shown to predict results 
that are contradictory to both interference theory and meaningful 
learning theory. 

James H. Crouse, University of Delaware and Merlin C. Wittrock, 
University of California, Los Angeles will discuss the papers. 



ISSUES IN l EARNING FROM DISCOURSE 

FRANK H. FARLEY, Wisconsin Research and Development Center for 
Cognitive Learning, University of Wisconsin, ORGANIZER 

Learning from prose or discourse research admits a wide variety of 
orientations in theory and methodology. The objectives of this 
symposium are to present different current orientations to this area, 
and to present empirical data which bear on these orientations. 
Consideration of these viewpoints and data should provide impetus to 
further research and understanding in this area, and suggest converging 
theoretical and empirical operations. 

Frank H. Farley, Wisconsin Research and Development Center for 
Cognitive Learning, University of Wisconsin, will present the paper 
"Arousal and Imagery in Children's Processing of Prose." 

Roy Freedle, Educational Testing Service, will present "Some 
Factors Which Affect the Decisions We Make When Exposed to Prose 
Material." The first problem explores some factors which affect the 
manner in which we identify the topic underlying a meaningful and 
connected string of words, from a finite list of subject matters (history, 
linguistics, anthropology, psychology, botany, physiology, physics and 
geology). The results showed that (a) as the number of alternative 
subject matters given to a S from which he made his identification 
increased from two to eight, the poorer was his ability to match the 
word string against correct subject matter from which it came, (b) for a 
fixed number of subject matters, as the amount of connected prose 
increased, the number of correct identifications increased up to perfect 
identification, and (c) subject matters which tend to emphasize social 
relationships (such as history, linguistics, anthropology, psychology) are 
more readily mutually confused than they are confused with subject 
matters which emphasize non-social concepts (such as botany, physiol- 
ogy, physics, geology). Two models are presented which attempt to 
clarify the kinds of cognitive divisions that are made in identifying 
subject matter. 

The second problem associated with prose comprehension is 
addressed to how explicit information given in a story is remembered, 
and how what is remembered will constrain the kinds of inferences that 
can be made about the story. By extending a conception due to Robyn 
Dawe (who maintains that what is learned when people listen or read 
prose is the set relation among key elements in the passage), the results 
of a study which employs a new method for assessing our memory for 
set relations were found to be dependent upon the particular quantifier 
used in the prose passage (the quantifiers were words such as all, some, 
or none). Several problems are then posed and some solutions offered 
for how our memory of the explicit set-relational information places 
constraints on our ability to draw inferences from the prose material. 

Jerome L. Myers, University of Massachusetts will discuss "The 
Effect of Organization of Prose Passages on Recall and Retrieval Time." 
In numerous recent studies of free recall, word lists organized by 
semantic category have been recalled more accurately and with a 
greater degree of organization than randomly organized lists. The 



present research considers the organization variable in the context of 
simple prose passages. Twenty-five sentences describe five attributes 
(climate, topography, language, agriculture, exports) of each cf five 
mythical countries. These sentences were then divided into five 
paragraphs of five sentences each. Organization was either by name (N; 
each paragraph dealt with a different country), by attribute (A; each 
paragraph dealt with a different attribute), or random (R). 

Subjects were required to read each paragraph for 40 seconds, and 
were then given six minutes to write down whatever they could recall. 
This was done three times. Cluster indices were highest for N Ss, R Ss 
showed considerably more N than A organization of output, and ASs 
frequently organized their output around names while N Ss organized 
their output exclusively around names. Despite this clear tendency for 
N output to evoke better organization of output and despite strong 
indication that N output is preferred to A, A Ss recalled significantly 
more than N Ss on all three trials. ,R Ss did as well as N Ss. 

One possible explanation is that reorganization of the input involves 
more processing and therefore better recall. Such reorganization was 
apparently occurring in the A and R groups who tended to organize 
their output around names. To test this hypothesis, three groups were 
run with instructions to serially recall. A Ss did as well as their free 
recall counterparts while N and R groups showed a significant 
impairment typically reported in studies of serial recall of lists. Thus it 
appears that the advantage of A Ss is at least as great and perhaps 
greater under serial as compared to free recall. Two other explanations 
suggest themselves. First, under A input the nonsense names of the 
countries received distributed practice while under N and R Ss perform 
less well than A Ss because of greater difficulty in learning the names. 
Analysis of errors of omission do not support this argument. 

A more likely explanation is suggested by responses to question- 
naires and by further data analyses. A Ss frequently report that they 
develop a strategy of learning lists of names, climates, languages, and so 
on. Since names were in the same order in each attribute paragraph, 
such a strategy is highly effective and equally sound for both free and 
serial recall because serial order information is easily retrieved. N Ss, on 
the other hand, appear to learn several lists consisting of a name and 
five attribute values with the attribute values in no particular order. 
Their learning is also more characterized by the use of mnemonics and 
imagery. 

In addition to the recall studies reported above, a variation of the 
Sternberg memory search task has been carried out with the same prose 
materials. Preliminary analyses indicate that rather orderly search 
processes are taking placa in the retrieval of name— attribute informa- 
tion. These data will provide a preliminary base for assessing the 
efficiency of various organizations of prose. 

Ernst Z. Rothkopf, Bell Telephone Laboratories, will present a 
paper entitled: "Shopping Lists, Shopping Carts, Memory Store." 
Capacity limit has been a persistent but elusive concept in theoretical 
accounts of learning from written discourse. Attempts have been made 
to characterize this limit in terms of rate of information processing in 
time, amount of learning per inspected unit, and so on. The concept has 
substantial intuitive appeal but it has been difficult to translate into 
operational language. It implies however fairly clearly that, when 
capacity is exceeded, there is a discernible trade-off between (a) factors 
that determine difficulty of processing on one hand and learning on the 
other; or (b) between learning of non-intersecting subsets of experi- 
mental passages. 

Evidence concerning the capacity limit hypothesis will be examined 
in the light of new experimental data on the relationship among 
learning measures, various measures of inspection rate, and stylistic 
characteristics of text. A second source of data about capacity limits 
are recent experiments about the effect of density of instructional 
objects in text on incidental and intentional learning. These findings as 
well as results from experiments on the phrasing of instructional 
objectives will be discussed in terms of the sources of limitation of 
peripheral and control processes during the study of written instruc- 
tional materials. 
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Lawrence T. Frase of Bell Telephone Laboratories will discuss the 
papers. 



MATHEMATICS IN EARLY CHILDHOOD: RESEARCH AND 
CURRICULUM 

ROBERT E. REA, University of Missouri, St. Louis, ORGANIZER 

The first paper will be "Classificational Abilities of Young Children" 
by Leslie P. Steffe, University of Georgia, in this presentation, 
classification abilities of young children will be discussed from a 
mathematical and a psychological point of view. Capitalizing on a basic 
theorem in mathematics which states that a one-to-one correspondence 
exists between the equivalence relations on a set S and the partitions of 
S, classificational abilities based on set equivalence and the congruence 
relation for segments, each an equivalence relation, will be discussed. 
How these relations and abilities are logically related to Piagetian 
cognitive development research will be discussed, during which struc- 
tural characteristics of classification will be made clear and researchable 
problems identified. Results of empirical studies done in light of the 
problems identified will be given, with suc&estions for further research. 

The second paper will be "Mathematical Abilities of Entering 
Kindergarteners" by Robert E. Reys, University of Missouri, St. Louis. 
A pilot test project with an experimental instrument, the Compre- 
hensive Mathematics Inventory, (CMI), has provided information 
concerning the mathematical abilities of over 700 children entering 
kindergarten. The similarities and differences between and among these 
subjects according to such variables as age, sex, family, race, and 
community type make for much interesting speculation, and provide 
certain assumptions for curriculum development. 

The third paper will be "Environmental Academics— A Pre-School 
and First Grade Program" by Robert C. Dwyer, University of South 
Florida. 

In the Fall of 1970 Environmental Academics was introduced in 
approximately 75 pre-school classes in Hillsborough and Pinellas 
Counties, Florida. These include 36 Head Start classes, 8 Migrant 
classes, and a number of classes at day care centers in the area. The 
program is also being used in 8 pre-school programs for the mentally 
retarded, and in one class of deaf preschool children. 

The purpose of this program is to help the child acquire skills and 
concepts in the process of solving problems he wants to solve. The 
academics (numbers, reading, writing and oral language) are embedded 
within the problem-environment. 

In Environmental Academics the child selects the items which he 
wants, by choosing word cards and number cards which are set in a rack 
in the classroom. The child walks over to the rack, chooses his cards 
according to what he thinks they say. He then goes to the table where 
the items are spread out, and counts out the items on his card, the kind 
and the amount. He solves the problem of matching the number on his 
card to the number of items that he takes, at his own level and in his 
own way, using dots printed on the back of the card if he needs them. 
These items are now his to keep. The child thus learns to discriminate 
through trial and error 

Each set of words and numbers is repeated for several days. At the 
beginning of the program, only two choices are offered each day. By 
the end of the program, nine or ten choices are offered each day. 

The fourth paper will be "Mathematics Through Activities and 
Materials and Self Conforming Behaviors for Three and Four Year 
Olds," by Edward Uprichard and John Wilson, University of South 
Florida. A theoretical rationale will be presented for a Number Program 
for 3 and 4 year olds which is based on self-conforming behaviors. The 
program is entirely embedded in materials and activities with pupil 
activities developed through the manipulation of concrete objects. The 
program has been pilot tested in Southern Florida and results will be 
presented. Additional research indicated as desirable by the project will 
be suggested. 



The fifth presentation will be "Number Program for Primary 
Schoolers" by James Moser, University of Wisconsin. The development 
work at the University of Wisconsin Research and Development Center 
in the area of number represents an attempt to delve into the thinking 
styles of youngsters. The program being developed is based largely on 
what we know through trial "will work". The program as it is 
developing will be described, and implications for other research and 
curriculum projects will be presented. 

The last presentation will be "An Activities- and Materials-Based 
Number Program for Kindergarteners" by Harold H. Lerch, University 
of Illinois, Urbana-Champaign. The program to be described has been 
developed "on the spot" in kindergarten classrooms in Carbondale and 
Urbana, Illinois. With a commitment to an informal approach within a 
planned approach, to a non-structured individualized program, to a 
materials and activities encasement, the program has developed bv 
selection, revision, and rejection processes. Research data has been 
gathered and will be reported. Moreover, implications for additional 
investigations and development projects will be presented. 



ORAL LANGUAGES DIFFERENCES: LINGUISTIC AND 

ATTITUDINAL CORRELATES 

THOMAS D. HORN, University of Texas, Austin, ORGANIZER 

The objectives of this symposium are: 1 ) to report recent research in 
oral language instruction tod the assessment of oral language, and 2) to 
discuss the implications of this research for the improvement of 
instruction. 

Muriel R. Saville, The University of Texas, Austin, will present the 
paper "Linguistic and Attitudinai Correlates in Indian Education". The 
Indian student's competence in language is not limited to his 
grammatical control over his linguistic systems— usually a native 
language and English. "Communicative competence," as defined by 
Hymes, includes expectations regarding linguistic behavior in encounter 
situations and attitudes toward language use. 

The critical relationship between attitudinai variables and the school 
achievement of Indian students has been solidly established by research 
and observation. This presentation identifies those variables reported 
which are related to linguistic differences, and adds data collected 
during the course of the author's involvement in Navajo/English 
bilingual education. Examples include purposes for using a language, 
naming conventions, taboos, styles of learning, and such related 
speaking behavior as gesture, intonation, and the use of silence. 

Conclusion: It is only by accepting the Indian student's attitudes as 
an educational base and relating our pedagogical approaches to those 
values that we can teach him effectively. 

N. Ruth Bradley, Lafayette Louisiana Schools, will discuss "Oral 
Language Proficiency in Reading Achievement of First Grade Children 
with a French Linguistic Background". In September 1969, a longi- 
tudinal study was begun to investigate the language patterns of school 
beginners from three socioeconomic groups in one of the Acadian- 
French parishes (counties) of Louisiana. The children were given a 
two-part oral language test which used a sentence repetition technique 
and a series of pictures to elicit free speech. This test, which yielded 
measures of phonology, morphology and fluency, was given in October 
1969 and April 1970 to 200 first grade pupils. The reading test of the 
SRA Primary Achievement Battery was administered to the same 
sample in April 1971. 

During the second year of the study an oral language development 
program, the Gloria and David Beginning English series, was introduced 
to a part of the disadvantaged black population. The oral language test 
was administered to this group and a control group from the 
disadvantaged black population in March 1971. 

Conclusion: There are distinct differences in the language patterns 
of beginning first graders in the three groups sampled. A study of the 
change in language patterns of Negro children in integrated schools and 
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in segregated schools revealed no differences in the rate of change in 
morphology and phonology. Correlations between reading achievement 
and the phonology and morphology measures of the oral language test 
seem to indicate that instrument's value as a predictor of reading 
achievement in disadvantaged black children. The language patterns 
(phonology and morphology) of the children receiving the experimental 
oral language development program changed at a much more rapid rate 
than did those of the control group. While differences in reading 
achievement between these two groups were not statistically significant, 
the difference favored Jthe experimental group. 

Diana S. Natalicio, The University of Texas, El Paso, and Frederick 
Williams, Center for Communications Research, The University of 
Texas, Austin, will discuss "Repetition as an Oral Language Tech- 
nique". The aim of the present research was to assess the degree to 
which sentence repetitious of black and Mexican-American children 
(grades K-2) could be used as a basis for language evaluation. Tapes of 
ten black and ten Mexican-American children who had responded to a 
set of commercially available test materials were evaluated by panels of 
experts. Evaluations for both groups were in terms of judgments 
concerning language dominance, SAE comprehension, SAE production, 
SAE phonology, SAE intonation, SAE inflections, SAE syntax, 
language pathologies and predictions of reading achievement. In 
addition, the Mexican-American children were evaluated on Spanish 
comprehension, Spanish production, Spanish phonology, Spanish 
intonation, and Spanish syntax. For each scaled evaluation, evaluators 
provided a description of their bases for judgment. Finally, evaluators 
responded to open-ended questions regarding instructional needs, 
reading achievement and overall reactions. 

Conclusion: Results indicated high reliability of scale judgments, 
except for ratings of intonation, language pathologies and for pre- 
dictions of reading achievement. The comments which served as bases 
for making scale judgments were highly consistent with language 
deviations typically identified in the two linguistic samples, and were 
congruent with the scale ratings themselves. Responses to open-ended 
questions were markedly inconsistent, often reflecting reticence to 
make major judgments based upon limited data as well as reflecting 
differences in philosophies for language instruction. 

Richard E. Sullivan, University of Rhode Island, will discuss 
"Differences in Oral Language as Bases for the Prediction of Spelling 
Errors". This research compared oral language production with the 
written realization of this production for a group of white and a group 
of Negro second graders attending public schools in Austin and San 
Antonio, Texas, respectively. 

Using an individually administered sentence repetition task to 
obtain a measure of oral language production, fifteen words were 
selected from the oral language assessment according to the criterion of 
a ten percent pronunciation difference from, the model for all 
phonemes within a word for all children in both groups. 

Scoring of the test was done in two ways: (1) a count was made of 
correct grapheme correspondences for the phonemes comprising the 
test; and (2) the tests were scored on the basis of rational and irrational 
grapheme/phoneme correspondences. In addition, twenty-five corre- 
spondences were selected for detailed analyses. 

Conclusion: Pronunciation differences which existed for the Negro 
children included those that existed for the white children. There was 
less variation between groups for oral production than for the written 
realization of the production. The Negro pupils omitted significantly 
more words and had significantly more irrational words than did the 
white pupils. Of 237 comparisons made between groups, 66 percent 
were not significant. 

The relationships that existed between pronunciation differences 
and spelling deviations for certain correspondences suggested that 
certain oral language characteristics including dialect features did effect 
spelling. 

Frederick Williams, Center for Communications Research, The 
University of Texas, Austin; and Diana S. Natalicio, The University of 
Texas, El Paso, will present the paper: "Carrascolendas: Evaluation of a 



Bilingual Television Series." This research represented the systematic 
evaluation of the production and effects of the television series 
"Carrascolendas," a program designed to facilitate the bilingual 
education of Mexican-American children. Product evaluation, or assess- 
ment of the effects of the series, was conducted by means of a field 
experiment involving children from the target audience population and 
by a survey of schools which used the program. Results of the field 
experiment indicated statistically significant learning gains of television 
viewers (as against a control group) in English tests of multicultural 
social environment, English language skills, physical environment, and 
cognitive development. Viewers also gained significantly in measures of 
overall language performance in both Spanish and English. These results 
had generality across first and second grades (except multicultural 
knowledge which increased only for second graders) and across 
classrooms either engaged or not engaged in bilingual instruction 
programs. 

Kenneth S. Goodman, Wayne State University, Ray Mazon and 
Mark W. Seng, University of Texas, Austin will serve as discussants. 



PARADIGMS IN CONCEPT ACQUISITION 

RICHARD C. BOUTWELL, Brigham Young University, ORGANIZER 

A behavior of central importance to all educators is that of concept 
acquisition. The proper method of teaching concept behavior has been 
the subject of many research efforts. Some of these research studies 
have tended to confuse the subject because of their lack of precision in 
specifying the essential independent and dependent variables associated 
with the desired behavior. This symposium examines some of the 
frequently proposed methods for investigating concept instruction and 
introduces paradigms which operationally define cognitive operations, 
predict errors, and provide methodology to make the transition from 
the experimental laboratory to the classroom. 

This symposium is composed of four presentations, given by 
educational psychologists who are all concerned with describing an 
empirically based theory of concept instruction. These authors have 
each approached this problem from different theoretical positions. 

"Conceptualizing Behavior of School Children" will be presented by 
Herbert J. Klausmeier, University of Wisconsin. A model of cognitive 
operations involves four levels of concept formation and the related 
cognitive operations, Klausmeier (in press). The four forms of concepts 
in the developmental sequence are designated as a concrete concept, an 
identity concept, a rudimentary classificatory concept, and a formal 
classificatory concept. The cognitive operations involved in forming the 
successively higher level concept start with discriminating objects on a 
norianalytic perceptual basis and eventually include more complex 
operations such as discriminating the defining attributes of a concept 
population, hypothesizing a concept, and evaluating hypothesized 
concepts according to various criteria. Also the use that the individual 
makes of learned concepts changes markedly with increasing maturity. 
The results and implication of studies validating cognitive operations 
will be presented and discussed by the symposium. 

"Relationships between Exemplars and Nonexemplars in Alternate 
Presentation Procedures in Concept Acquisition Instruction" will be 
presented by M. David Merrill, Brigham Young University. Two studies 
were conducted dealing with concept acquisition. The first study was a 
pilot study and is similar to Dr. Robert Tennyson's on the optimal 
temporal and spatial relationships of exemplars and nonexemplars in 
instruction. This study used a different population and task. 

The second study was concerned with various types of presentation 
procedures for concept acquisition. The task used was the concept 
trochaic meter from poetry. The independent variables involved the 
following presentation procedures: (1) presentation of a definition 
only, (2) presentation of a definition plus further definition of the 
attributes, (3) presentation of exemplars and nonexemplars only, (4) 
presentation of the definition plus exemplars and nonexemplars, and 
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(5) presentation of the definition plus exemplars and nonexemplars 
using a prompting procedure which calls Ss attention to relevant 
attributes. 

The preliminary findings indicate that higher correct classification 
scores result when a definition is accompanied by exemplars and 
nonexemplars and that the best correct classification scores were 
attained when an attribute identification prompting procedure is 
employed during instruction. 

"Concept Learning and Learning From Prose" will be presented by 
Lawrence T. Frase, Bell Telephone Laboratories. The classical literature 
on concept learning has relied heavily upon an inductive paradigm. In 
contrast, an expository text might teach concepts by asserting 
relationships in a small number of sentences. Is telling what a concept 
is, sufficient? If not, how should one tell what a concept is, i.e., what 
things should a writer know and do to insure concept acquisition from 
text? This paper reviews the contribution that concept learning 
literature might make toward an understanding of prose learning. It 
deals with the problem, processes and variables that are common to 
laboratory and reading tasks. The author considers the role of structure, 
sequence, exemplars and nonexemplars, etc., in prose learning, and 
treats the question of what current research, methodology and theory is 
available to provide a transition from the experimental laboratory to 
the prose learning situation. 

"Instructional Model for Concept Acquisition" will be discussed by 
Robert D. Tennyson, Florida State University. A new. concept is 
acquired when a person correctly identifies previously unencountered 
objects or events as members or nonmembers of a particular class. In 
order to assess concept acquisition both exemplars and nonexemplars 
must be presented to the learner and his ability to generalize to new 
exemplars and discriminate them from nonexemplars observed. 

The present paradigm identifies instructional variables which 
operationally define procedures to predict learner acquisition, and if 
manipulated logically, predict the errors. These errors are: over- 
generalization (occurs when the learner correctly identifies all of the 
exemplars as class members, plus identifying some nonexemplars as 
members of the class); undergeneralization (occurs when the learner 
identifies the more obvious exemplars as class members'but indicates 
that less obvious exemplars are not class members); and misconception 
(occurs when the learner falsely assumes that some irrelevant attribute 
or combination of irrelevant attribute or combination of irrelevant 
attributes is relevant). 

The instructional paradigm involves the manipulation of three 
variables: probability, divergency and matching. Probability refers to 
the difficulty level of exemplars for a specific population. Divergency, 
refers to the relationship between exemplars. 

Matching refers to the relationship between exemplars and non- 
exemplars. I n this situation the irrelevant attributes should be as similar 
as possible, with the difference between the two being the relevant 
attributes. 

Instruction developed according to the paradigm outlined does 
operationally define the relationship of instances. Empirical data does 
substantiate the manipulation of variables. 

The educational importance of this symposium is that for the first 
time the emphasis of the research is on concept instruction and the 
teaching of concepts rather than the basic learning mechanisms. Three 
very different approaches have been brought together representing 
different techniques and paradigms in the teaching of concepts, rather 
than how people learn concepts. 

Those three paradigms include the manipulation of concept 
exemplars and nonexemplars, concept presentation in prose learning, 
and a model of cognitive operations which postulates levels of concept 
acquisition. The definition and exposure of these parameters in 
teaching new concepts should carry important implications to the 
classroom teacher as well as the research and development centers 
across the country. 



PRESCHOOL EDUCATION VIA TV: CURRICULAR OBJECTIVES, 
METHODS OF INSTRUCTION AND MEANS OF ASSESSMENT 

EUGENIA M. KOOS, Mid-Continent Regional Educational Laboratory, 
ORGANIZER 

The success of Sesame Street in accelerating letter and number 
recognition by preschoolers appears unquestioned. It may be that the 
effectiveness of the TV medium for bringing about learning could best 
have been demonstrated only in this dramatic way. But to prepare 
children for living in a complex society, however, would seem to 
require thoughtful designation of learning objectives that make full use 
of the medium's potential as a vehicle for simulation. Only in this way 
can the need for acceleration of multi-dimensional learning be met. The 
medium is so powerful a tool for instruction during the critical 
preliterate years that decisions on its use should be a matter of 
interdisciplinary discussion and public involvement. 

Proponents of different learning theories may need equal time in 
public forums in which they would present evidence for the greater 
desirability of their chosen positions. Careful studies of research 
findings on the effectiveness of the methods being proposed will be 
required and objectively interpreted in order to provide decision-makers 
with necessary information about means of attaining desired objectives. 
Thus it is of considerable importance that we resolve the problems 
associated with attempted assessment of outcomes of instruction via a 
medium that spans vast distances between source of the signal and its 
reception by the learner. 



READING: THE STATE OF THE ART 

STANLEY F. WANAT, International Reading Association, 
ORGANIZER 

In July, *1970, three U.S. Office of Education sponsored studies of 
reading began. These studies were to 1) characterize the reading 
activities of adult Americans and to set goals for what they should be 
reading, 2) analyze the research literature on language development, 
learning to read, and the reading process, and 3) describe the nature of 
the reading problem in the U.S., the types of methods and materials 
used in the teaching of reading, and the status of teacher training 
programs in reading. 

The purpose of these research projects was to provide information 
which could serve as a basis for setting national literacy goals, for future 
reading research activities, and for developing new materials and 
techniques in teaching reading. At the 1971 American Educational 
Research Association's meetings, a symposium was presented to inform 
the educational research community about the activities of these three 
projects. Now that two of these three projects have completed their 
activities, and the third is approaching completion, the objective of this 
symposium is to present the results of these studies. 

Donald A. Trismen of the Educational Testing Service, will present 
an analysis of criteria for reading achievement. The purpose of the ETS 
Princeton project was to describe the reading behaviors of American 
adults, and then to develop a set of tasks to be used to assess 
achievement in reading. The tasks aim to be representative of the tasks 
that adults actually engage in. Also, a measure of the value of each task 
to the reader was to be ascertained. These value measures are based on 
the results of a survey, and on opinions given by a panel representing 
different groups in American life. 

This report on reading goals will present the results of surveying this 
panel of representatives on what Americans ought to be reading. The 
judgments of a sample of approximately 4,500 adult readers on the 
value of different kinds of reading activities will also be presented. An 
analysis of the reading activities of the people in this survey will be 
provided, dealing with four content categories (books, newspapers, 
magazines, mail) and in various daily activities (meals, working around 
the house, school, work, traveling or commuting, shopping, club or 
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churck, theater, games or other public events, and recreational and free 
time). Finally, a description of the development of these selected 
reading tasks, and the nature of the tasks themselves, will be discussed. 

Martin Kling of Rutgers University will present the results of the 
Literature Search in Reading. The principal outcomes of the Literature 
Search were the detailed analysis of approximately 900 references and 
the writing of 21 analytical and critical papers summarizing the research 
on various aspects of reading. 

Without an adequate and integrated understanding of the behavioral 
operations upon which language and reading are based, appropriate 
procedures for teaching beginning reading to all children, and for 
development and refinement of these complex skills cannot be 
constructed confidently and effectively. Yet a great body of un- 
coordinated evidence of varying quality has been accumulated con- 
cerning language and reading, and in recent years a number of basic 
disciplines increasingly have concerned themselves with questions 
related to these areas. To be useful to the educator, this diverse body 
of literature must be identified, evaluated and integrated. 

The specific objectives of this project were to: 

1. Identify and evaluate all significant contributions to the litera- 
ture in: 

a. language development 

b. learning to read 

c. the reading process 

2. Identify explanations in the literature of how these processes 
operate and how the behavioral events of operations within them 
interact. 

3. Describe and synthesize models and partial models, to present as 
many different logically coherent models in each area as seemed 
necessary. 

4. Describe hypotheses and associated tests needed to refine and 
extend models presented, to test assumptions and to synthesize 
with them the unincorporated facts and insights of fields 
studied. 

This report will characterize the approximately 900 references 
which were analyzed in detail by the project. Such factors as the types 
of models of language development, of learning to read and of the 
reading process will be discussed. The type of model (e.g., isomorph, 
analogy, or example), its comprehensiveness, and its research basis will 
be analyzed. The constituent elements of the various models will be 
presented, along with their strong conclusions and their assumptions. 
Additionally, the research designs of the studies underlying the models 
will be critiqued. A synthesis of the theories within each of the three 
areas will be presented, along with a synthesisof the theories across all 
three areas. 

Patricia Elias of the Educational Testing Service, Berkeley, will 
present a report assessing the extent and distribution of the reading 
problem in the U.S. The first part of this report will consist of the 
identification, analysis, evaluation, and summary of existing survey and 
test data. The report will assess the reading characteristics of various 
groups, dealing with factors such as sex, age, race, I.Q., S.E.S., 
geographic area, home language, and parents' education. 

Second, different methods, texts, and equipment used in the 
teaching of reading will be reported on. The relationship between 
different knowledge-bases and various methods of teaching reading will 
be evaluated, and the relationships between methods of teaching 
reading and the achievement of various subgroups of learners will be 
assessed. 

Third, the nature of teacher training programs in the field of reading 
will be described, along with certification standards for teachers of 
reading in the U.S. Finally, studies of the relationship between teacher 
training programs and teacher performance will be summarized and 
evaluated. 

The analyses to be presented here are based on an examination of 
approximately 1,800 references. Studies were critically reviewed using a 
set of analytical rating criteria. A synthesis of these 1,800 studies will 
be presented as a basis for providing information about the teaching of 



reading and the reading status of various subpopulations in the U. S. 

Marvin Glock, Cornell University, Sara Lundsteen, University of 
California, Irvine; Stanley F. Wanat, International Reading Association, 
will discuss the papers. 



THE ROLES OF RESEARCH IN INSTRUCTIONAL DEVELOPMENT 

EVA L. BAKER, University of California, Los Angeles, ORGANIZER 

Observers on the educational scene must conclude that recent trends 
indicate an increasing dependence upon instructional development 
rather than on more traditional forms of instructional research to solve 
pressing educational problems. Although such is the proper role for 
development endeavors, a shift in emphasis is not likely to be greeted 
with universal acclaim. Because Division C members of the American 
Educational Research Association probably have the most obviously 
vested interest in maintaining support of instructional research, per se, 
it seems especially appropriate that a symposium on the research- 
development interface be addressed to them. The symposium 
participants, both presentees and discussants, include individuals who 
have had enormous experience in both research-focused organizations 
and in development agencies. By presenting their reason perceptions of 
the ways research studies interplay with instructional development, 
they will be providing information from which the Division C audience 
can clearly profit. While one does not hope for instant alternation in 
the career lines of the audience, one would expect that the discussion 
could at the very least stimulate the audience to conceive of new ways 
to utilize existing research skills, perhaps in specialized instructional 
development contexts. 

While it is conceded that instructional research has had difficulty in 
producing results of agreed-upon impact, the promise of instructional 
development may be short-lived, if procedures, whether or not 
research-based, are not evolved for improving the technology from 
which instructions! development springs. The symposium will also be 
addressed to this problem. 



TEACHER-PERFORMANCE CRITERIA: THEIR SPECIFICATION 
EVALUATION, APPLICATION IN THE SCHOOLS, AND IMPLI- 
CATIONS FOR TEACHER EDUCATION 

ESIN KAYA, Hofstra University, ORGANIZER 

The proposed symposium is organized to present the different 
involvements of different institutions in the specification and evalua- 
tion of teacher performances, in their utilization by school districts, 
and in their incorporation to developing teacher preparation programs. 
The participants in the symposium have formed a consortium to deal 
with these different aspects in a coordinated manner. The papers 
represent an account of the actual experiences of each institution and a 
specification of what is desired in the future. 

Dr. Robert Finley's (Glen Cove Public Schools) paper leads the 
symposium. It lists a number of "performance criteria" currently used 
in certifying teachers as proficient, and contrasts these with per- 
formance criteria that would be desirable to have in a school district. 
Thus the paper establishes the need for a new set of criteria which 
should serve as the behavioral objectives for teacher preparation 
programs. Emphasis is placed on experience rather than course- 
completion, skills needed to individualize, rather than fulfill require- 
ments for all, teaching people instead of a subject or grade-level. Some 
specific attempts to shift these emphases are described. 

Dr. Esin Kaya's (Hofstra University) paper gives an account of the 
process of specifying teacher behaviors and establishing a taxonomy 
based on empirical data. The results of research utilizing 144 teacher 
behaviors falling into a predetermined classification system are 
presented. A taxonomy of teacher behaviors is proposed based on 
differentiated roles to be performed by teachers with differing talents. 
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interests, competencies, and proficiency. The taxonomy is explained in 
detail with sample behaviors in each category. Evaluation based on the 
proposed taxonomy would yield a profile for each teacher to be 
considered by a school district in hiring staff. The profile would be 
descriptive of an individual's strengths and weaknesses thus assuring a 
matching of the individual with the job without the necessity of passing 
or failing anything. 

Dr. Fred McDonald's (Educational Testing Service) paper gives an 
account of the research and development conducted at the Educational 
Testing Service concerning the evaluation of teacher performances. It 
specifically describes in some detail the research that has resulted in the 
development of new tools for evaluating teachers' discussion skills. 

Dr. Jonathon Messerli's (Hofstra University) paper briefly places the 
"teacher-performance" movement in its historical perspective and 
discusses an input-output model of teacher-training as it has been and as 
it is likely to be in the future. So far professional educators have 
concerned themselves with input (the incoming novice) and with a 
controlled and manipulated process (the formal curriculum), confident 
that as these two components were improved so too would be the 
output. Now with the identification of desirable teacher performance, 
the attention must shift to the actual output and then work back. To 
do this will not necessarily force the abandoning of the older model. It 
will give a more realistic set of priorities, will undercut the hegemony of 
the 3-semester hour course, will blunt the endemic strife between 
"academicians" and "educationists" by creating better cooperative 
efforts, and will challenge the tyranny of the grade point average in 
admission procedures. It will provide an effective empirical basis for 
systematically reforming the present teacher-training programs and 
ultimately improve the quality of teaching in the schools. 

Dr. William Boyd (New York State Education Department) was 
selected as the discussant to criticize the symposium in view of the New 
York State Education Department's interest in exploring new styles of 
certification. Changes in teacher certification procedures implied by the 
preceding papers are weighed against the possibilities that are realistic, 
efficient and effective in meeting the instructional needs of public 
schools. 



VERBAL LEARNING AND READING RESEARCH: SOME 

PERSPECTIVES ON LEARNING BY READING 

GARY M. INGERSOLL and DONALD J. CUNNINGHAM, Indiana 
University, ORGANIZERS 

This symposium will focus on the topic of learning by reading by 
exploring the possible points of articulation between reading research 
and verbal learning research- It is our belief that these two sources of 
information are sufficiently complementary that several insights might 
be developed for an understanding of the reading process. However, few 
attempts have been made to view reading from this joint perspective. 

Reading researchers have often dismissed verbal learning research as 
too basic to have relevance while reading research, on the other hand. 



has often been characterized as oriented toward the development of 
teaching techniques. If the former approach fails to generate practical 
application, the latter approach fails to offer a sound theoretical base 
for an understanding of the processes involved in skilled reading 
behavior. 

The members of this symposium, two trained in reading and two 
trained in verbal learning research, will attempt to outline some of the 

areas of research on learning by reading implied by the merging of these 

\ 

two disciplines. In so doing, they will review previous research 
consistent with this orientation and present some preliminary research 
findings on the process of reading verbal material for meaning. 

Dr. Donald J. Cunningham of the Institute for Child Study and 
Department of Educational Psychology at Indiana University will offer 
a quasi-theoretical conceptual model for viewing research on reading 
and verbal learning. This system draws heavily on the information 
processing models of memory put forth recently by such learning 
psychologists as Neisser, Bower, and Atkinson and Shiffrin. Representa- 
tive research in five major areas will be briefly reviewed to illustrate the 
utility of the model: 1) characteristics of reading material associated 
with efficient reading, 2) identification of the content of reading 
materials, 3) the processing strategies correlated with reading for 
meaning, 4) individual differences in reading and 5) measuring learning 
outcomes from reading for meaning. The other presenters will elaborate 
one or another of these areas. 

Dr. J. Jaap Tuinman of the Institute for Child Study and 
Department of Reading at Indiana University will offer some per- 
spectives on the problems associated with measuring comprehension. 
The validity of an investigation of learning by reading may depend 
heavily upon the definition of the dependent variable. Thus it becomes 
clearly important to delineate what is meant by comprehension of 
verbal materials and what is implied by different measures of 
comprehension. In his discussion. Dr. Tuinman will pursue method- 
ological and conceptual problems associated with the various measures. 

Dr. William E. Blanton of the ERIC Clearinghouse on Reading and 
Department of Reading at Indiana University will pursue problems 
associated with the use of "cognitive organizers" in textual materials. 
Dr. Blanton will summarize the work of Ausubel and others on the use 
of structured organizers in meaningful reception learning. Dr. Blanton 
will define problems implicit in the use of Ausubel's model and offer 
some speculation as to the use of cognitive organizers in reading 
research . 

Dr. Gary M. IngersoII of the Department of Educational Psychology 
at Indiana University will discuss the desirability for including 
individual difference variables in the investigation of learning by 
reading. As Cronbach, Jensen, and others have noted, far too often the 
variance accounted for by different aptitudes which interact with the 
experimental treatments is included in the error term. Dr. IngersoII will 
present arguments favoring the use of the aptitude by treatment 
interaction paradigm in reading research. 

Dr. Lawrence T. Frase of the Bell Telephone Laboratories will act as 
discussant to this symposium. Dr. Frase will be free to react to any or 
all of the positions presented by the four participants. 
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DIVISION D: MEASUREMENT AND 
RESEARCH METHODOLOGY 

PAPER SESSIONS 

APPLICATIONS OF MONTE CARLO METHODS I 

Rational Approximations of the Inverse Gaussian Function 

JACKSON A. BYARS and JOHN T. ROSCOE, Kansas State University 

There are at least two situations in which the behavioral scientist 
wishes to transform uniformly distributed data into normally 
distributed data: (1) Where uniformly distributed pseudo-random 
numbers are generated but normally distributed numbers are desired, 
and (2) Where standardization of an instrument requires normally 
distributed standard scores from percentile ranks. Using Chebyshev 
polynomials, Hastings has derived two approximations which have been 
widely used. Burr, using cumulative moment theory, has also derived 
two approximations, but these have not been widely used. The authors 
have derived a new and simpler approximation which is more accurate 
than either Hastings or Burr over the range p = 0.01 to 0.99. 

A Monte Carlo Investigation of the Analysis of Variance Applied to 
Non-Independent Bernoulli Variates 

JOHN F. DRAPER, CTB/McGraw-Hill 

It is noted that some investigators have had success in showing that 
the Analysis of Variance (ANOVA) is to some extent robust, under 
certain conditions, when applied to zero-one type data. A repeated 
measures situation is presented in which it appears desirable to consider 
zero-one type item response evaluations as dependent variables. Monte 
Carlo results are reported with respect to the application of ANOVA to 
data simulated under a model of the above situation, particularly results 
which indicate when ANOVA is definitely not robust. Implications and 
suggestions conclude the paper. 

An Empirical Comparison of Four Chi-Square ana Kolmogorov Models 
for Testing Goodness of Fit to Normal 

HOWARD M. KITTLESON and JOHN T. ROSCOE, Kansas State 
University 

Traditionally, goodness-of-fit to normal has been tested with a 
chi-square model in which cell limits are defined by dividing a standard 
score scale into equal parts. Some authors have suggested that cell limits 
should be defined by dividing the area under the curve into equal parts. 
Other authors have suggested the use of the Kolmogorov statistic. The 
investigators used Monte Carlo techniques to compare the validity and 
power of the chi-square and Kolmogorov tests using both the equal 
score intervals and equal areas models. Of the four models tested, the 
chi-square equal areas model proved superior in every respect. 

A Comparison of Three Methods of Analyzing Dichotomous Data in a 
Randomized Block Design 

GARRETT K. MANDEVILLE, University of South Carolina 

Analysis of variance (ANOVA) techniques are often used when the 
data obtained in an experiment satisfy the paradigm of the randomized 
block design. Less assumptive multivariate methods are also available as 
are nonparametric techniques developed by Friedman (xf) and 
Cochran (Q). In this Monte Carlo study three of these analytic 
techniques (ANOVA, multivariate and Q) are compared when the data 
are dichotomous. Comparisons of empirical and nominal Type I error 
and power are given for various success proportions, degrees of 
dependence among the observations within a block, number of 
treatments and number of blocks. 



The Effects of Pooling the Interaction and Within Components on the 
Alpha and Power of the Main Effects Test 

JOHN T. POHLMANN, Southern Illinois University 

The Monte Carlo method was used, and the factors considered were 
(1) level of main effects in the population; (2) level of interaction 
effects in the population; (3) alpha level used in determining whether to 
pool; and (4) number of d.f^j thin . The results indicated that when the 
ratio d.f. axb /d.f. W j th j n was large (Va), pooling resulted in a disturbance 
in the actual alpha for the main effect test. The magnitude and nature 
of the disturbance was dependent upon the alpha level employed in 
testing the interaction effects. The use of an alpha of .25 for the 
interaction effects resulted in a congruence between actual alpha and 
nominal alpha, and a slight increase in power. 

The Robustness of the Studentized Range Statistic to Violations of the 
Homogeneity of Variance and Normality Assumptions 

GARY C. RAMSEYER and TSE-KIA TCHENG, Illinois State 
University 

Monte Carlo methods were employed to investigate the robustness 
of the studentized range statistic. For several sample sizes and numbers 
of groups, sets of 2000 q-values were generated and Type I error rates 
were determined. Extreme variance ratios of 1:1:4 for normal 
populations produced error rates up to only 6.9% and 2% for the 
nominal 5% and 1% levels respectively. Violations of only the normality 
assumption using exponential and rectangular distributions resulted in 
rates negligibly below the nominal levels. Simultaneous violations of 
both assumptions led to maximum rates of 8.2% and 23% respectively. 
It was concluded that q is quite robust. 



COMPUTER TESTING 

Utilizing the Computer to Assess the Readability of Language Samples 

NORMAN A. FELSENTHAL and HELEN FELSENTHAL, Purdue 
University 

This research demonstrates the utilization of a specially developed 
computer program to facilitate the calculation of eight well-known 
readability formulas; e.g., Flesch, Dale-Chall, Gunning, and others. 
Three 100-word samples were selected from each of twenty elementary 
trade books. The sixty language samples were computer-processed and 
each yielded eight different readability scores. Correlation techniques 
compared the similarity or dissimilarity of the eight different read- 
ability quotients. Chi-square techniques measured the internal con- 
sistency of the readability levels within each book. The study illustrates 
the feasibility of employing computers to determine the readability 
level of language samples. 

Scoring Creativity Tests by Computer Simulation: A Validation of the 
Prediction Equations 

JOHN F. GREENE, University of Bridgeport; PERRY A. 21RKEL, 
University of Connecticut 

In recent years several studies have attempted to utilize the 
computer to simulate human behavior, especially human rating be- 
havior. None of the resulting prediction equations, however, have been 
validated in other similar populations. Consequently, the objective of 
this study is to determine the general usefulness of prediction models 
designed to score creativity tests by computer. The results indicate that 
certain prediction models are stable and useful, with cross-validated r's 
ranging from .85 to .89. Other models, however, are deemed relatively 
unstable as shrinkage approached .40. Restricted and forced prediction 
models as well as full models are analysed. 





Computer Analysis of Cloze Data To Develop a Readability Formul* 

ROGER ISON, MILTON D. JACOBSON and RAMSAY SELDEN. 
University of Virginia 

Twenty thousand words of Cloze test data were administered to 
nineteen subjects to determine empirically the readability rate of the 
text. The text itself was keypunched and analyzed by compute to 
measure the appearance rate of a number of objective variables of 
readability. The empirical readability of the text was compared xo the 
appearance rate of the variables to yield a correlation of .8. It ^vas 
concluded that large volumes of Cloze data could be useful in 
developing objective measures of readability. 

Computer-Generated Verbal Test Reporting 

WALTER M. MATHEWS, University of Mississippi 

An alternative to traditional test reports will be presented: 
automated reports that were designed for teachers and parents and that 
are in a verbal format. These reports were built around the Iowa Tests 
of Basic Skills and were generated for a random half of th$ 52 
fourth-grade classes in 16 elementary schools in Madison, Wisconsin. 
The reports were evaluated by comparison to the traditional reports 
and were rated significantly higher (a = .01) on every scale (clear,, 
useful, meaningful, valuable, sufficient, accurate). The experimental 
reports were also found to have a greater impact on teacher perception 
of student performance. 

Test Homogeneity and Response Stability 

THOMAS A. TYLER, Southern Illinois University 

Response stability in non-ability tests was studied in a test-f e test 
design as a function of test homogeneity. Items and persons were scaled 
with the Rasch model and the absolute difference of scale values vvas 
used as an index of psychological distance between subject and itePL As 
anticipated small psychological distances were associated with response 
instability over time.. Also, the predictability of response stability 
increased as the tests increased in homogeneity. Implications were made 
for the study of subject-acquiescence, subject-variability, control of 
acquiescence, item-stability, and general strategies for test construction. 



CRITERION REFERENCED TESTS 

Student Evaluation: Toward the Setting of Rational, Criterion- 
Referenced Performance Standards 

JAMES H. BLOCK, University of California, Santa Barbara 

This study lays some footings for the development of rational, 
criterion-referenced, performance standard setting techniques. The 
differential effects of the maintenance of various criterion-referenced 
standards on selected cognitive and affective learning criteria are 
examined. The findings suggest that the maintenance of different 
standards will maximize student learning depending upon the cPteri# 
by which the learning is operationalized. Further, they imply that the 
commonly observed relationship between individual difference* and 
student achievement often may be a sheer artifact of present 
instructional practices and, hence, that individual differences may be 
over-used as a scapegoat for ineffective instruction. 

An Index of Efficiency for Fixed-Length Mastery Tests 

CHESTER W. HARRIS, University of California, Santa Barbara 

A rationale is presented for an index of efficiency of fixed length 
mastery tests. An ideally functioning mastery test which consist* of fc 
items which require the construction of responses can be characterized 



as a test for which the conventional ANOVA s*Jms of squares for Items 
and for Items-by-Persons are both zero. A fixed length mastery test 
which functions in a less than ideal fashion can be characterized by a 
ratio, varying between zero and unity, that is a function of three sums 
of squares. The relation of this ratio to the conventional Hoyt 
reliability coefficient is commented on. 

Criterion-Referenced Testing of Inquiry Skills in High School Biology 

EUGENIA M. KOOS and JAMES Y. CHAN, Mid-Continent Regional 
Educational Laboratory 

Six Explorations in Biology (simulated investigations for high school 
students) were tested in junior/senior high and college biology classes in 
a six-state study of appropriateness of difficulty level for the 
high-school target group, concurrent validity, range and standard 
deviations of scores, and class means. Findings were: difficulty level is 
appropriate to the target group; concurrent validity has not yet been 
established; intercorrelations of all ElB tests are less than .75, so that 
no two could be used alone as alternate forms. Intercorrelations of ElB 
total scores with DAT VR+NR affirms reasoning as major inquiry 
component. / 

Toward an Evaluative Methodology for Criterion-Referenced Measures 

DAN GILBERT OZENNE, Southwest Regional Laboratory for Educa- 
tional Research and Development 

That traditional test evaluation techniques may be inappropriate for 
use in the evaluation of criterion -referenced measures has been noted 
by a number of researchers. This paper presents an evaluative concept, 
based on the sensitivity of a measure to differences in competency 
levels, which may be useful in the evaluation of criterion-referenced 
measures. Various response models are presented which lead to 
estimates of a test's sensitivity. The topics of item analysis and selection 
are discussed in relation to each item's contribution to overall test 
sensitivity. The usefulness of the sensitivity concept is demonstrated 
through the analysis of empirical and simulation data. 

Adapting Criterion-Referenced Measurement to Individualization of 
Instruction for Handicapped Children: Some Issues and a First Attempt 

BARTON B. PROGER, LESTER MANN, ROBERT M. BURGER, and 
LAWRENCE H. CROSS, Pennsylvania Resources and Information 
Center for Special Education 

Criterion-referenced measurement (CRM) has received increasing 
attention in regular education. However, it is in education for 
handicapped v children that CRM's flexibility for individualization of 
both instruction and evaluation become even more fully realized. 
Research is described on one of the first CRM systems (Individual 
Achievement Monitoring System: IAMS) ever devised exclusively for 
the handicapped and designed for widespread implementation. Method- 
ological problems are discussed, such as inappropriateness of item 
sampling, difficulties in retention testing, and determination of ade- 
quate criterion levels of mastery for handicapped children. Flexibility 
of research findings based on CRM is also examined. 

A Strategy for the Evaluation of Individualization 

LARRY J. REYNOLDS, University of Pittsburgh 

A strategy for the evaluation of individualization was tested for its 
feasibility. The logic of the evaluation procedure is that a pupil's 
curriculum placement and his independently measured achievement 
should have a high degree of correspondence. Correlations were made 
between reported pupil placement and measured performance on an 
achievement test. High correlation coefficients were found between the 
achievement test results and the curriculum placement of the pupils 



whose classrooms were known to be highly individualized. The 
coefficients appear to be reliable indexes of individualization. The 
evaluation procedure should be useful to those interested in either 
formative or summative evaluation problems. 



DATA ANALYSIS TECHNIQUES I 

An Empirical Investigation of the Effects of the Violation of the 
Assumption That the Covariable in Analysis of Covariance is a Fixed 
Variable 

DICK S. CALKINS and EARL JENNINGS, University of Texas, Austin 

The mathematical derivation of the statistics used for inference in 
some linear models assumes that values of the independent variables are 
pre-selected such that these variables can be treated as fixed rather than 
random variables. This assumption is often disregarded when these 
models are utilized in research. This study is an investigation of the 
consequences of the violation of this assumption. The results of this 
study indicate that when the sample size is not too small the 
consequences of the violation of this assumption are of little practical 
significance. 

On the Factor Analysis of Longitudinal Data 

A. RALPH HAKSTIAN, University of Alberta 

Five models are introduced for the factor analytic treatment of a set 
of measures obtained for the same sample of persons on two different 
occasions. The models differ in terms of the assumptions made 
regarding the constancy of the (1) factor (actually component) score 
and (2) factor pattern matrices from occasion 1 to 2. Least-squares 
procedures are developed for the estimation of the component scores 
and patterns under each model, and illustrative examples using these 
procedures are presented. The research implications of the hypotheses 
and procedures associated with each model are discussed. 

The Effects on Factor Structure of Several Different Correlation 
Estimates for Attitude Scale Scores 

LAURISTON L. KEOWN and A. RALPH HAKSTIAN, University of 
Alberta 

This study involved an investigation of the use of the Pearson r, 
tetrachoric r, phi coefficient, phi/phi-maximum, and Kendall's tau-B 
coefficient as measures of relationship for the incomplete principal 
components analysis of simulated Likert-type data based on a known 
factor pattern and possessing different types of severe departures from 
normality. The results suggested that Kendall's tau-B was most robust, 
with respect to distributional distortion, with large or small samples, 
followed by the Pearson r. Phi, phi/phi-maximum, and tetrachoric 
r tended to yield distorted and, in some cases, too many components. 

The Accuracy and Stability of Estimated Total-Test Statistics from 
Unstratified and Stratified Item Samples 

DAVID J. KLEINKE, Syracuse University 

In a post-mortem study of item sampling, 1,050 examinees were 
divided into ten groups fifty times. Each time, their papers were scored 
on four different sets of item samples from a 150-item cest of academic 
aptitude. These samples were selected using (a) unstratified random 
sampling and stratification on (b) content, (c) difficulty, and (d) both. 
There were no systematic relationships between method of sampling 
and accuracy or stability (defined in terms of the means and variances 
of the distributions of the estimates) of estimated total-test mean or 
variance. Implications for both generalizability theory and item 
sampling methodology are discussed. 



Rating Dimensions of Course and Instructor Characteristics: The Eye of 
the Beholder 

A. JON MAGOON and J. R. PRICE, University of Delaware 

Student ratings of instructional quality are typically expected to 
reveal the dimensions along which courses and instructors vary when 
mean rating information on multiple rating characteristics has been 
intercorrelated. Principal component analyses of 21 sets of rating data 
based on differences (1) between classrooms, (2) within classrooms, and 
(3) within classrooms in an unfamiliar context, reveal very similar major 
dimensions, with congruence approaching .90 for the first two 
components. It is concluded that such rating information reveals far 
more about student preconceptions of how rating characteristics are 
related than it does about meaningful instructional quality dimensions. 

The Assumption of a Markoff Chain Model for Interaction Analysis 

DEAGELIA M. PENA, Appalachia Educational Laboratory, Inc. 

A Likelihood Ratio Criterion based on a two-step Markoff Chain 
Model was developed for interaction data. At the same time, a 
simulation based on a one-step chain model produced an empirical 
distribution of Darwin's criterion which then became the basis of 
suggesting cut-off points of the chi square values for the rejection of the 
hypothesis of equality of two interaction matrices. Such rejection 
would then reflect educational significance. The steps in this investi- 
gation were also clearly formulated to allow replication for the 
extension of the tables which were generated. 



EVALUATION TECHNIQUES 

Educational Research and the Confidentiality Issue: Methodological 
Perspectives 

ROBERT F. BORUCH, Northwestern University 

* The paper appraises three kinds of strategies which are useful in 
maintaining data confidentiality during educational and evaluative 
research. The first technique involves administrative actions which 
permit the researcher to obtain information from identified respon- 
dents or to merge information from independent sources, without 
compromising legal constraints against invasion of privacy. Statistical 
strategies are exemplified by Greenberg's randomized response tech- 
nique, microaggregation research and reliability models. The techniques 
permit the researcher to develop estimates of population parameters, 
using data which can only be associated stochasticly with individuals. 
Legal strategies are exemplified by model statutes which provide legal 
protection to the data elicited by a social researcher from a research 
subject. 

A Motion Picture Screening Test for Perceptual Disabilities 

ERNEST D. McDANIEL, Purdue University 

A motion picture test of perceptual abilities has been developed for 
use as a screening test with elementary school children. Part I has 
twenty-five items in which the child must identify a hidden stimulus 
figure within one of four designs. Part II contains 25 items in which a 
child must identify from four alternatives a figure formed by three or 
four separate lines which have been presented successively. The test is a 
16mm sound film, is self administering and requires about 30 minutes 
of total testing time. It is appropriate for use in Grades One through 
Three. 





Identification of Potential Discrepant Achievers When Something Can 
Be Done About It 

JONATHAN J. CURTIS, New Mexico State University 

This study was conducted to identify an "optimal” discriminant 
model for classifying in the first grade potential discrepant achievers 
with respect to reading achievement. Eleven predictor variables, tapping 
widely different dimensions, were used. Only three of these were 
contained in the "optimal" model identified, the Peabody, an "Adjust- 
ment" measure, and a "School Anxiety" measure. Discriminant 
Analysis was found to be a practical technique for identifying 
discrepant achievers. An independent sample was utilized to cross- 
validate the findings. 

Sibling Methodology in Evaluative Research 

DANIEL P. NORTON, Educational Testing Service; RICHARD W. 
FAUNCE, Minneapolis Public Schools 

The development and implementation of innovative educational 
programs almost always proceeds so the program evaluator cannot 
apply true experimental methodology to program evaluation. Family, 
community and school variables are therefore poorly accounted for in 
many evaluation designs. Sibling methodology can offer advantages to 
evaluators seeking to control for these variables. A first phase of the 
application of sibling methodology to a major project in the Minne- 
apolis Public Schools showed no main or first order interaction effects 
for birth order, sex or variety of program but revealed higher 
achievement for 343 younger siblings in the new program. 

An Evaluation System for a Psychoeducational Treatment Program for 
Emotionally Disturbed Children 

C. J. HUBERTY, University of Georgia; J. P. QUIRK and W. W. SWAN, 
Rutland Center 

A general description of an overall evaluation system which is being 
implemented in a cente; for emotionally disturbed children is pre- 
sented. The complete involvement, in terms of planning, monitoring, 
and appraising activities and goals of the evaluation component of the 
center are discussed. The application of the system to the evaluation of 
direct services to children, which involves five phases (intake, staffing, 
monitoring, termination, and tracking) including three periodic 
measurement instruments (employed during the monitoring phase), is 
discussed. The system provides for periodic feedback of information 
useful in formulating decisions regarding the individual child and the 
treatment program. 

The Use of Simulation in the Design of a Computer Based Instructional 
Management System 

BURTON J. ROFFMAN and JOHN F. McMANUS, Southwest Regional 
Laboratory for Educational Research and Development 

The IBM General Purpose System Simulator (GPSS) provides a 
powerful tool for the analysis and differentiation of complex phe- 
nomena. GPSS appears particularly applicable to the design of 
instructional management systems involving the simultaneous inter- 
action of several defined subsystems. For example, the subsystems of 
the SWRL Instructional Management System (IMS) include a data 
concentrator, remote optical scanners, and remote output devices, as 
well as the central processing computer. This paper describes the 
procedures followed and the problems encountered in performing 
simulations to design IMS. It includes a description of the functional 
characteristics of the communication components and details of the 
various control algorithms evaluated in the course of the simulation 
studies. 



MEASUREMENT MODELS 

An Analysis of Personality Data Using Rasch Measurement Model 

ERNEST P. FOWLER and WILLIAM J. BRAMBLE, University of 
Kentucky 

A Rasch model anlaysis of variance subtests of the I PAT High 
School Personality Questionnaire (HSPQ) is presented. The analysis was 
performed on item response data collected on a sample of five hundred 
6-l2th grade students in the Louisville Public Schools during 
September, 1970 and May, 1971. The results and discussion center 
around the question, "How useful is the Rasch procedure when applied 
to single scales on a typical personality test?" In answering this 
question, such things as the fit of the model, discrepant items and 
stability of the item calibration across two points in time are discussed. 

A Study of The Use of Multiple Regression with" Dummy Variables to 
Identify Instructor Contribution to Student Achievement 

BARRY GREENBERG and RICARDO MEJIAS, Miami-Dade Junior 
College 

This study examined differences between instructors in their 
contributions to student achievement. Multiple regression analysis was 
employed with independent variables consisting of measures of each 
student's past academic record, the size of the class and a dummy 
variable to represent the student's instructor. The dependent variable 
was scores on a Social Science departmental final examination. Results 
revealed the effectiveness of this approach in isolating and rank 
ordering each instructor's contribution to student achievement. 
Obtained regression coefficients for instructors paralleled department 
chairman ratings. The discussion included a recommendation that 
colleges take steps to gather more quantifiable student "input" data. 

Maximum Likelihood Estimation of Ability under the Normal Ogive 
Model: A Test of Validity and an Empirical Example 

DONALD L. KOLAKOWSKI, University of Connecticut; R. 
DARRELL BOCK, University of Chicago 

A Fortran IV Program has been developed for the maximum 
likelihood estimation of the parameters of the normal ogive model, 
with or without guessing constants, by means of a generalized probit 
analysis. The present paper investigates the bias of the above technique 
in the recovery of a true score distribution and utilizes this model in an 
empirical problem requiring a distributional analysis. Using both 
synthetic and empirical item response data, we find that the presence of 
a guessing effect requires its corresponding response model and that 
recovery is excellent if certain extreme cases can be omitted and the 
possibility of guessing can be ruled out. 

A Comparison of Some Nonparametric Tests for Scale 

DOUGLAS A. PENFIELD, Rutgers University 

The two-sample variance problem is described in detail. When the 
assumptions underlying the parametric F-test cannot be satisfied, the 
researcher can select from a variety of nonparametric alternatives to 
test for scale equality across two populations. In this paper the 
Siegel-Tukey Test, Mood Test and Normal Scores Test are selected as 
possible alternatives to the F-test and contrasted with respect to score 
replacement procedures, computations and power efficiency for 
specified alternatives. The tests are illustrated and compared for both a 
small sample study and their large sample approximations to the normal 
distribution. 




75 

86 



Jackknifing Disattenuated Correlations 

W. TODD ROGERS, National Assessment of Educational Progress 

The jackknife is a general inferential technique intended to 
ameliorate the problem* associated with an inadequate distribution 
theory. The purpose of this research was to investigate, using computer 
simulations, the utility of the jackknife for establishing confidence 
intervals on and testing hypotheses about the disattenuated correlation 
coefficient. Forty-five combinations of N, p(TxTy)> and piXJC) and 
p(y,n were investigated. The results support the claim that the 
jackknife can be used to set approximate confidence intervals about 
p(7x,7>), thereby communicating a general idea of the precision of 
the estimate obtained. However, the jackknife should not be used to 
perform directional hypotheses tests. 



MULTIVARIATE METHODS I 

On the Extraction of Components and the Applicability of the Factor 
Model 

CHARLES D. DZIUBAN, Florida Technological University; CHESTER 
W. HARRIS, University of California, Santa Barbara 

An example is cited in which Bartlett's Test for Sphericity would 
not have precluded component analysis with a correlation matrix of ten 
variables of interest and four random deviates; however the principal 
component analysis of that matrix using the Kaiser number of 
components forced an interpretation of random correlations. It is 
shown that Alpha and Uniqueness Rescaling Factor Analysis, as well as 
Image component analysis eliminates the problem by yielding as the 
first factors (components) those correlated essentially zero with the 
random variables. 

The Use of Pattern Analysis for the Prediction of Achievement Criteria 

DAVID H. FRIEDMAN, Resource Management Corporation 

Linear and nonlinear combinations of variables were used to predict 
single and multiple criteria for the purpose of improving predictability. 
Results of the analyses indicated that ample linear combinations of 
predictors seemed to be the most appropriate model in both conditions. 
Coupled with other findings, it appeared that single criterion prediction 
was probably best accomplished using simple linear combinations. For 
the prediction of multiple criteria, however, it was suggested that a 
further examination of the model be considered. 

A Comparison of Several Methods for Estimating the Number of 
Factors to Retain in Factor Analysis 

VICTOR J. MULLER and A. RALPH HAKSTIAN, University of 
Alberta 

Eight well-known decision rules for deciding on the number of 
components, common-factors, or image factors (the three models were 
considered) were applied to correlation matrices taken from the 
literature, and ranging in size from six variables to 34. The number of 
factors suggested by each procedure is compared with that from L^e 
other techniques, and the effects of sample size and number of variables 
on these estimates are discussed. Those techniques that tend to suggest 
too few factors are identified and rejected as misleading. An analysis 
strategy using two or more of the procedures is presented. 



On the Analysis of Partitioned Data 

ROBERT M. PRUZEK, State University of New York, Albany; 
CHARLES A. STEGMAN, University of Pittsburgh 

This paper is to describe a new method for studying partitions 
(disjoint categories of items, objects or stimuli). The method, which is 
related to Wiley's (1967, Psychometrika) latent partition analysis, is in 
part inferential, for testing hypotheses about structural relations among 
partitioned items, and in part exploratory, for direct analysis of 
partitions. The method is discussed in relation to three previously 
developed methods and is applied for the analysis of two sets of 
partitioned data. Two general descriptive statistics are defined. Their 
null distributions are deduced for certain special cases of the general 
model; their inferential and descriptive characteristics are examined. 

Choosing a Design Matrix for the General Linear Model: ANOVA 

GERALD J. SCHLUCK, Florida State University 

In the general linear model approach to analysis of variance, the 
model Y = p + G is replaced by the model Y =X&+ G. Since either X or 
P may be chosen by the experimenter, an infinite number of design 
matrices exist. Investigation of four choices of design matrix (identity, 
many-one, orthogonal contrast and standard anova) is performed for 
two common analysis of variance situations. The situations are: 
one-way analysis with unequal sample sizes; two x three factorial design 
with unequal sample sizes. Comparative remarks are made about 
interpretability, distribution of estimates and tests of hypothesis. 

An Application of Statistical Inference to the Factorial Invariance 
Problem 

ERNEST N. SKAKUN, T. O. MAGUIRE and A. R. HAKSTIAN, 
University of Alberta 

Attention has been drawn to a weakness in comparative factor 
analysis. This weakness is due to the absence of standards for evaluating 
the degree of goodness of fit of two factor patterns. An empirical 
sampling distribution of the statistic average trace (E'E) asE is obtained 
in the orthogonal Procrustes problem for various orders of A matrices 
was developed through a Monte Carlo approach. Percentile values of the 
statistic were computed and can be used as guidelines in determining 
the difference or congruence of factor patterns obtained from two data 
sets. 



MULTIVARIATE METHODS II 

An Empirical Comparison of Three Indices of Variable Contribution in 
Multiple Group Discriminant Analysis 

CARL J. HUBERTY, University of Georgia; PAUL J. BLOMMERS, 
University of Iowa 

This paper is concerned with the comparison of three proposed 
indices of predictor variable potency: (1) the scaled weights of the first 
Fisher-type discriminant function, (2) the total group estimates of the 
correlations between each predictor variable and the first Fisher-type 
function, and (3) the within-groups estimates of the correlations 
between each predictor variable and the first Fisher-type function. It 
was found that given a single run of an experiment none of the indices 
were sufficiently reliable to be of great practical value in identifying 
potent variables except when the total sample size was very large. 





An Investigation of the Robustness of Covariance Structure Analysis 

WILLIAM J. BRAMBLE and ROBERT H. BROWN, University of 
Kentucky 

The robustness of the estimation procedures and hypotheses tests 
for a class of covariance structure models is investigated by system- 
atically violating the assumption of multivariate normality. The models 
considered are special cases of the general model 2 = A <t> A' + ^ in 
which A is completely specified. Estimation and hypotheses testing 
procedures are applied to sample covariance matrices with known 
underlying structure. The sample covariance matrices are computed 
from generated data of the following types: (1) multivariate normal; (2) 
otherwise multivariate normal, but including ten percent or twenty 
percent outliers; and (3) multivariate gamma with one, ten, or thirty 
degrees of freedom. 

The Use of Contrast Coding to Simplify ANOVA and ANOCVA 
Procedures in Multiple Linear Regression 

ERNEST L. LEWIS and JOHN T. MOUW, Southern Illinois University 

The major purpose of this paper was to present and discuss 
“contrast coding" procedures in handling ANOVA and ANOCVA 
designs in multiple linear regression. Coding predictor vectors so that 
they reflect a set of orthogonal contrasts among cell means was found 
to simplify the procedure and to yield more specific answers to possible 
research questions. A lack of independence between a contrast vector 
and the covariate in ANOCVA was found to lead to a possible biasing 
of the F-test but a minor modification in the procedure was found to 
solve the problem. 

A Two Group-Two Treatment Research Design 

JAMES W. MAXEY, Georgia State University 

This presentation will focus on the discussion and illustration of a 
unique two group-two treatment research design. This design allows the 
assessment of the individual and combined effects of the two 
treatments as well as allowing for each group to serve as its own control 
group. In addition, the design provides for internal replication of the 
experiment. An example will be included in the presentation, showing 
how this design was used for the evaluation of an in-service training 
project. Also, several suggestions will be made regarding the appropriate 
techniques to analyse the data collected for use of this research design. 

Multivariate Analog of Hays (J 2 

DARSHAN SACHDEVA, University of California, Berkeley 

The multivariate analog of Hays (J 1 for estimating the strength of 
the relationship in the multivariate analysis of variance is proposed in 
this paper. The multivariate a? 2 (denoted by co 2 mu | t ) is obtained 
through the use of Wilks' A test criterion. Application of <o 2 mu | t to a 
numerical example is provided so as to help understand the mechanics 
of the formulas necessary for the computation of (J 2 mu |t- 

Use of the Analysis of Covariance Structures to Explore the Issue of 
Correlated Versus Uncorrelated Latent Random Variables 

WILLIAM H. SCHMIDT, Michigan State University 

The analysis of covariance structures procedures were employed to 
examine the issue of correlated versus uncorrelated latent random 
variables in six sets of empirically generated data. Also explored were 
the hypotheses of homogeneous error variances and the need for scale 
factors in the mixed model. The data were generated from learning trial 
experiments and psychometric applications. The results suggested that 
Scheffe's criticism is generally warranted, i.e., the specification of 



uncorrelated latent random variables does not seem to be realistic for 
most behavioral data. This implies the inadequacy of the traditional 
specification of the mixed model for the analysis of variance. 



OBSERVATION SYSTEMS 
Causal Models in Educational Research 

JAMES G. ANDERSON, Purdue University; FRANCIS B. EVANS, 
University of Wisconsin, Green Bay 

The major objective of this paper is to explore the utility of causal 
models in educational research. Data concerning child rearing practices, 
achievement motivation, and achievement among a sample of 89 
Mexican-American and 39 Anglo-Americans in the junior high schools 
of a southwestern community have been used to illustrate the potential 
of this model building procedure for providing a powerful means of 
interpreting statistical relationships based on educational theory. A 
causal structure involving relationships hypothesized as existing among 
the set of variables found to be related to achievement has been 
specified. Algorithms are provided that permit the definition of a set of 
structural equations and the estimation of model parameters. 

Process Evaluation Via an Observation Device 

KATHERINE A. BEMIS and MAX LU FT, Southwestern Cooperative 
Educational Laboratory 

The Southwestern Cooperative Educational Laboratory has 
developed an observation schedule to allow program evaluators to 
monitor teaching techniques. Through a series of revisions based upon 
statistical analysis an increasing correlation with student gain has been 
achieved. The schedule has been used by 300 teachers in a six state area 
during the 1969-70, 1970-71, and 1971-72 school years. Post observa- 
tion conferences held with the teachers insure increasing goal directed 
behavior and decrease random behavior by the teacher. 

Relationship of High-Inference and Low-Inference Observation 
Measures 

BARAK ROSENSHINE, University of Illinois; PHILIP LIMBACHER, 
Texas A and M University 

Student ratings of teacher behavior, and observer category system 
counts for the same 17 teachers were obtained on two occasions— at the 
start and at the end of the student teaching period. Consistent 
correlations between the two measures were not obtained across the 
two periods. The lack of replicated correlations may be due to the 
instruments: the rating scale was open, whereas a category system is 
ipsative. Consequently, the results of studies in which student ratings 
and behavior counts on only one occasion were correlated need to be 
reconsidered because of the different scales of the two instruments. 

An Attempt to Modify tbs Teaching Behavior of Elementary School 
Interns Through the Use of a Theoretical Planning Model 

A. EDWARD UPRICHARD, RICHARD BEDICS and LEON 
GREABELL, University of South Florida 

The present study was designed to evaluate the efficiency of a 
theoretical planning model, FACT, in modifying the teaching behavior 
of elementary school interns. FACT is designed explicitly to identify, 
examine, classify, and/or quantify the learning stimuli that are available 
to the learner in a given teaching-learning situation. The experimental 
treatment comprised approximately two hours of instruction; one hour 
to present and discuss the theoretical implications of FACT and the 
second hour trying to bridge the gap between theory and practice. The 
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dependent variable was the number of different stimuli used by an 
intern in a given teaching segment. Results are presented. 



PROBLEMS OF EVALUATION IN URBAN ENVIRONMENTS 

Planning School Desegregation 

EMMETT B. KEELER, The Rand Corporation 

This paper describes the mathematical models and data handling 
procedures we have developed to help large metropolitan areas plan 
school desegregation. The methodology was checked by constructing a 
variety of sample plans for Los Angeles. We discuss how racial balance 
might be measured, how bussing costs, financial and psychic, can be 
approximated, and how schools and children should be aggregated into 
regions to facilitate the analysis. Applying linear programming tech- 
niques, we present some sample plans. Finally, we describe how we 
derived the Los Angeles data, and suggest other data handling 
procedures. 

A Factor Analysis of Several Readiness Measures for Different 
Socioeconomic and Ethnic Groups 

PAULA A. MATUSZEK and THOMAS OAKLAND, University of 
Texas 

A number of readiness tests were administered to groups of first 
grade children chosen from two socioeconomic (SES) and three ethnic 
groups. A varimax factor analysis was performed to determine what 
factors the tests seem to measure and whether these factors differ for 
children from different SES and ethnic groups. It was found that the 
tests measured widely differing factors depending on both a child's SES 
and his ethnic background. Also the tests measured fewer factors than 
might be expected from the number of subtests, suggesting inefficient 
test batteries. 

Cognitive Modes in a Group of Black Kindergarten Children 

SHERLE L. BOONE and LORRAINE M. NICOLICH, Rutgers 
University 

This research investigates the interrelationships of three types of 
measurement instruments used with nineteen Black kindergarten 
children. The instruments used were the Harris-Goodenough Draw-A- 
Man test, measures derived from the Wallach and Kogan designed 
creativity instruments and the Comtois Early Childhood Rating Scales. 
It was found that the drawing I.Q. and the creativity instruments are 
tapping separate modes of cognition in these children, which may be 
related, to a degree, to general intelligence and creativity. Multivariate 
analysis of the Comtois scale indicated that there are differences in the 
classroom behaviors of children which are related to their ranking on 
the instruments employed. 

Personality and Occupational-Interest Correlates of Disadvantaged 
Students 

ANTHONY T. SOARES and LOUISE M. SOARES, University of 
Bridgeport 

Disadvantaged high school males indicated on the Minnesota 
Vocational Interest Inventory a preference for service-oriented jobs. 
Disadvantaged females tended toward office work and selling. On the 
Jr .-Sr. HSPQ form of the I PAT, both groups showed a pattern of 
personality which can be described as group-dependent, restrained, 
relatively unfrustrated, self-assured, feeling few obligations, somewhat 
detached yet self-assured, less oriented to intellectual pursuits, and a 
tendency toward emotional instability and low-ego strength. The 



disadvantaged females were significantly differentiated from the males 
in tough-mindedness and self-reliance. The correlation of these 
measures was -58, significant at the .01 level. 



PROGRAMMING MODELS 

Prediction of Teacher Turnover Employing Time Series Analysis 

CRIST H. COSTA, Milwaukee Public Schools 

The purpose of the study was to combine knowledge of teacher 
demographic data and time-series analysis to predict teacher turnover. 
Teacher demographic characteristics were combined for submission to a 
time-series model developed for use on the computer. Four years of 
historic data were used as a base upon which to predict the rate of 
turnover in the fifth year. Four combinations of time-series analysis 
were employed for every prediction with an accurate prediction defined 
as an estimate within ten percent of the actual turnover. All four 
methods seemed equal in predictive ability and overall accuracy was 
forty percent of all estimates made. 

A Linear Programming Model to Optimize Various Objective Functions 
of a Foundation Type State Support Program 

ORVILLE R. MATZKE, University of Iowa 

Educators, attempting to provide equal and quality education, are 
concerned about the rising cost of education. This study formulated a 
linear programming model to simulate a foundation type program for 
financing public education. The model was capable of simulating the 
financial characteristics of the 453 local districts in the State of Iowa. 
The input data required is a district identification number, assessed 
valuation and average daily membership. Five objective functions were 
solved to test the flexibility of the model. Many foundation programs 
may be computed and evaluated to determine the best alternative in 
terms of the priorities of the system. 

A Simulation Model for Facility Planning for Independent Study 
Activities in a Flexible Modular Scheduling Program 

RICHARD E. MUNSTERMAN, Purdue University 

The purpose of this paper is to present a computer simulation model 
for use by decision makers in educational facility planning. This model 
can be used to determine the proper space allocations needed for 
resource facilities in a flexible modular scheduled high school. The 
sources of data for this simulation model are the Stanford Scheduling 
Program (SSSS), a student survey of unscheduled time activities, and a 
Management Information System being developed by the Iowa Educa- 
tional Information Center. The programming language used for this 
model was IBM's GPSS/360. A discussion will be presented on various 
uses of this model for facility planning. 

A Linear Programming Model for Assigning Students to Attendance 
Centers 

ROBERT L. ONTJES, Northwest Missouri State College 

A linear programming model was developed and tested to assign 
students to attendance centers. Policies concerning racial balance were 
used. The input by geographic area requires number of students and 
number of minority students by grade, and the distance to each school. 
The input by school requires capacity and allowable percent of 
minority students by grade. The output includes the percentage of each 
residential area assigned to each school, the enrollment for each school 
by grade and the total transportation for the system in pupil-miles. This 
is an optimal "least-cost" solution. 
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The Use of Linear Programming for Prediction 

CARL J. SCHNITTJER, University of Iowa 

The objective of this study was to consider the feasibility of 
regression analysis using linear programming with a "least absolute 
difference" criteria as an alternative to the usual "least squares" 
regression procedures. The two methods of prediction were compared 
using data on 66 Ph.D. graduates of the University of Iowa. Results 
were in favor of linear programming over curvi-finear multiple re- 
gression. In some cases, in fact, it is possible to obtain a zero sum of 
residuals using linear programming. Although the model needs further 
testing, it appears that linear programming offers a viable alternative to 
multiple regression for solving prediction problems. 



STUDIES IN VALIDITY 

Comparative Reliabilities and Validities of True-False and Multiple 
Choice Tests 

DAVID A. FRISBIE, Wichita State University; ROBERT L. EBEL, 
Michigan State University 

The purpose of this study was to compare the reliabilities of 
true-false (TF) and multiple choice (MC) tests and to determine the 
concurrent validities of TF tests. Two methods, judgmental and 
discrimination, were devised for objectively converting MC items to T F 
form. The TF items generated by the two methods from 70-item MC 
natural science and social studies tests were incorporated in eight final 
forms which were differentiated by subject matter, conversion method, 
and item form order. The TF tests were significantly less reliable than 
the MC tests and did not necessarily measure the same thing as the 
corresponding MC tests. 

Methodology for Instrument Validation: An Application to Attitude 
Measurement 

ROBERT K. GABLE, University of Connecticut; ROBERT M. 
PRUZEK, State University of New York, Albany 

The purposes of this paper were to (1) examine both judgmental 
and response data gathered for developing an attitude instrument, and 
(2) discuss genera! issues related to a proposed methodology for 
examining content and construct validation. Employing 36 college 
presidents, latent partition was illustrated as an appropriate technique 
for examining content validity. Constructs were identified by factoring 
item response data for 212 college students. A comparison between the 
item response factors and the LPA categories indicated substantial 
agreement. Problems with the present interpretations and its advantrges 
over typical methods for content and construct validity were discussed. 

Validating Learning Hierarchies for Sequencing Mathematical Tasks 

E. RAY PHILLIPS, University of South Florida; ROBERT B. KANE, 
Purdue University 

The purpose of this study was to develop and evaluate indirect 
procedures for validating learning hierarchies. An initial hierarchy for 
rational number addition was constructed. A test to assess mastery of 
each of the 11 levels was administered to elementary school children. 
The pass-fail relationships were analyzed using seven validation pro- 
cedures. Programmed lessons for each subtask were sequenced 
according to each hierarchical ordering generated. The differential 
effects of sequence upon time to complete the program, achievement, 
transfer, and retention were investigated. The results indicate that the 
overall efficiency of the learning process can be affected by sequence 
manipulation. 



Development and Validation of an Observation System for Analyzing 
Teaching Roles 

REBA K. SOUTHWELL, Mississippi State College for Women; 
JEANINNE N. WEBB, University of Alabama 

Two approaches to validation of a classroom observation system are 
described. A theoretically based S2-sign instrument. Teaching Role 
Analysis in Childhood Education (TRACE), was validated by making 
observation records of classroom behaviors of 28 teachers in six 
selected Follow Through models. As the system discriminated among 
experimental models, TRACE records were obtained by five trained 
observers in 40 primary and preschool classrooms. Patterns of teaching 
behaviors related theoretically to specified roles were clearly identified 
in both highly structured experimental models and in conventional 
classrooms; specific behaviors were identified that discriminated among 
roles. TRACE seemed to be a valid measure theoretically and 
empirically of teaching role. 



STUDIES RELATED TO TESTING PROCEDURES AND 
CONDITIONS 

Racial and Ethnic Bias in Test Construction 

DONALD ROSS GREEN, CTB/McGraw-Hill 

Publishers of standardized tests ordinarily use "typical" groups of 
children in tryouts for item selection. This is a study about the degree 
to which the items chosen depend on the characteristics of the tryout 
groups. The responses of seven different groups of children in three 
sections of the country were used to select the "best" half of the items 
making up the California Achievement Tests, 1970 Edition . Four 
groups of relatively privileged children were compared with one of 
three disadvantaged groups. Results indicate the use of different groups 
lead to somewhat different tests measuring somewhat different things. 

Implementing a Mixed Program of Criterion and Noncriterion- 
Referenced Measurement 

HAROLD F. RAHMLOW, American College of Life Underwriters 

For established educational programs there is the need for a careful 
reassessment of associated measurement programs to determine 
whether or not they are meeting their objectives. This paper sum- 
marizes some activity that is taking place to introduce the concept of 
criterion-referenced measurement to a program that has not been 
criterion-referenced. Introduction of criterion-referenced measurement 
has moved the American College of Life Underwriters measurement 
activities from a noncriterion-referenced into a mixed mode. One of the 
strong forces which influenced this move toward criterion-referenced 
measurement was a need to document progress in improving instruc- 
tional materials. 

Testers' Influence on Children's Intellectual Performance 

JAMES E. SAVAGE, JR. and NORMAN D. BOWERS, Northwestern 
University 

This experiment provided information for optimizing the test-taking 
environment. Ten black and ten white testers tested 240 students 
randomly selected on the basis of race, school type, and grade level. 
Utilizing a 2x2x3 factoral design and two intellectual tasks multi- 
variate analysis of variance indicated: 1) Blacks performed significantly 
higher on one task with the same-race testers, and 2) The significant 
tester-racial effect was not mediated by school type or grade level, but 
it was mediated by the nature of the task. The findings were interpreted 
vis-a-vis an anxiety hypothesis (Yerkes-Dodson Law), amount of verbal 
interaction and type of feedback. 
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A Replication and an Example of Serendipity in Educational Research 

T. SALVATORE TOCCO, University of South Florida; CHARLES M. 
BRIDGES, JR., University of Florida 

A replication of a past study (Tocco and Bridges, 1971) presented at 
AERA was conducted. Self-concept measures were collected on 1,004 
deprived mothers and their children. Canonical analyses re- 
substantiated that self-concept measures of mothers are related to 
self-concept measures of their children [R - .32, p< .05] ; and that 
beginning of school year self-concept measures of mothers are related 
to change scores of their children over the school year [R = .26, 
p < .05] . A non-hypothesized relationship between beginning of school 
year self-concept measures of mothers and end of school year 
self-concept measures of children [R - .66, p< .001] was established 
serendipitously. 



TEST CONSTRUCTION II 

A Validity Study of the Self-Esteem Inventory 

H. JOHN LANDIS, Pennsylvania Department of Education 

The purpose of this study was to indicate the construct validity of 
Coopersmith's Self-Esteem Inventory (SEI) at the seventh grade level. 
The validation procedures used were (1) to determine if a difference 
existed between high and low achievers on the SEI and (2) to determine 
if there was a significant correlation between the four factors and total 
score of the SEI and the four factors and total score of the 
Self-Concept as a Learner Scale (SCAL). Significant differences 
(p < .01) were found between high and low achievers on three factors 
of the SEI and the total score. Significant positive correlations 
(p < .01) were found between two factors and total scores of the SEI 
and SCAL. 

Model for Use of Sodometry to Validate Attitude Measures 

THOMAS P. McGUINESS and PEGGY L. STANK, Pennsylvania 
Department of Education 

A 32-item instrument measuring a student's attitude toward people 
who differ from himself on the dimensions of race, religion, SES, IQ 
and physical characteristics was constructed utilizing a Likert scale. A 
sociometric instrument was used to validate the attitude measure. The 
hypergeometric distribution was used to compute varying probabilities 
of choice combinations occurring by chance on the sociometric 
measure, and any observed choice combination with a probability 
greater than .05 was accepted as evidence of the presence of bias 
relevant to the specific variables being considered. Likert t*s, indices of 
discrimination, were found to be significant for all items. A reliability 
of .732 was identified. 

The Development of an Experimental Sensory-Motor and Movement 
Skill s Test Battery 

RUSSEL E. ORPET, California State College, Long Beach 

The purpose of this project was to develop an experimental test 
battery that would be useful as a research instrument to assess the 
movement skills of elementary school age children. The major 
theoretical basis for this project was the factor analytic studies of 
movement. The experimental test battery consists of 12 subtests which 
require approximately 20 minutes to be individually administered. The 
test battery was administered to 744 Caucasian public school children 
of six to twelve-years of age. Reliability estimates based upon test-retest 
r's ranged from .43 to .87 with a median reliability coefficient of .79. 
The test battery correlated .34 with reading achievement at Grade I. 



Use of the Semantic Differential in Describing a Pre-School Environ- 
ment 

THERESA R. RAPER and JOHN L. WASlK, North Carolina State 
University 

Teachers and assistant teachers (N - 32) from two rural counties in 
North Carolina rated five pre-school educational settings and one 
hypothesized ideal setting using a semantic differential in order to 
determine if the semantic differential could be used to reliably 
differentiate between pre-school educational environments. Five dis- 
crepancy scores (i.e., setting— ideal) for each semantic attribute were 
analyzed by a 2x2xo complete factorial multivariate analysis of 
variance. It was concluded that the semantic differential did provide a 
basis for interpreting differences in perceptual attributes of educational 
settings and that these differences were related to the prior background 
of the subjects and data gathering environment. 



TEST CONSTRUCTION III 

The Generation item Hierarchies by an Ordering-Theoretic Method and 
a Piagetian Example 

WILLIAM M. BART, University of Minnesota; PETER W. AIRASIAN, 
Boston College 

In this study an ordering-theoretic method to generate item 
hierarchies is explicated and an empirical example is provided as a 
hierarchy among a set of Piagetian test items is generated. The data 
analytic method emanates from ordering theory which is a boolean 
algebraic measurement model. The method to be discussed requires 
bivalent items as are the Piagetian tasks with Genevan protocols being 
used. To exemplify the method, the response patterns obtained from 
the Piagetian tasks administered to Minneapolis-area students are 
analyzed with the procedure. This method can be used to onpomte a 
hierarchy among any set of items. 

Relationships Between Objective Test Formats 

JOHN FOLLMAN, BRUCE HALL, RUSSELL WILEY and JANICE 
RODGERS, University of South Florida 

The objective of this study was to attempt to determine if the 
respective actual factor structures of four hypothesized different test 
formats, i.e.. Fill in the Blanks, Matching, Multiple Choice, and True 
False, actually were different. An item having the same content was 
made for each of the four formats. Factor analysis of the 86x86 
inter-item phi matrix of the combined Matching, Multiple Choice, and 
True False formats indicated 34 small factors made up of weak item 
loadings from all three formats. It was concluded that there is no 
evidence that the hypothesized different types of tests actually differ. 

The Efficiency Index in Item Analysis 

RICHARD J. HOFMANN, Miami University (Ohio) 

In this paper a new item analysis index, e, is derived as a function of 
difficulty and discrimination to represent item efficiency. Inasmuch as 
item discrimination in this paper is not independent of item difficulty it 
is demonstrated algebraically that the maximum discriminating power 
of an item may be determined from its difficulty. Item efficiency is 
defined as the ratio of observed discrimination to maximum discrimi- 
nation. 

The e-index will range from zero to unity and will provide 
additional information for item analyses. Its probability interpretations 
may provide ar. attractive psychometric criterion for the retention or 
rejection of items. 






To Change or Not to Change Item Responses When Taking Tests: 
Empirical Evidence for Test Takers 

DANIEL O. LYNCH and BILLIE C. SMITH, Wisconsin State Uni- 
versity, Oshkcsh 

The response changing behavior of 168 students on their final exams 
showed that response changes based on reasoned consideration of test 
items tend to raise test scores. With wrong-to-wrong response shifts 
ignored, 68% of the residual shifts were from wrong-to-right and 32% 
were from right-to-wrong. The authors conclude that many students 
have been led astray by professors and peers advising them not to 
change their first answer choices. 

Passing Scores and Test Lengths for Domain-Referenced Measures 

JASON M I LLM AN, Cornell University 

Suggestions are offered for establishing standards and determining 
the number of items needed in criterion-referenced measures. The 
discussion of setting a passing score is organized around four factors: 
item content, educational consequences, psychological and financial 
costs, and measurement error. Tables relating test length to proficiency 
standard and required accuracy are provided. Other schemes for setting 
standards and arriving at test length are evaluated. 

Comparative Reliabilities of the Multiple Choice and True-False 
Formats 

ALBERT C. OOSTERHOF and DOUGLAS R. GLASNAPP, University 
of Kansas 

The present study was initiated to investigate the comparability of 
multiple choice and true-false item formats when the time necessary to 
respond to each type of item was equated empirically. Also investigated 
was the relative difficulty of multiple choice (MC),true true-false (Tf), 
and false true-false (tF) items measuring the same content. Results 
indicated that true-false items result in a less reliable test than one using 
a four-option MC format, even when empirically determined differences 
in time needed to answer the respective formats were taken into 
account. When scores were corrected for guessing, the MC items were 
significantly easier than the true-false format. 



TEST CONSTRUCTION IV 

Attitude Toward School and Learning: The Development of a Seventh 
Grade Instrument for Measurement of Goal IV of the Pennsylvania 
Quality Assessment Program 

GEORGE E. BREHMAN, JR., Pennsylvania Department of Education 

Previously developed Pennsylvania Educational Quality Assessment 
instruments for measurement of attitudes toward school and school 
learning were examined with the intent of creating an improved 
seventh-grade version of the instruments which are now used at the 
fifth and eleventh grade levels. Items designed to measure new factors 
or attitudes independent of school context were constructed, as well as 
items that might improve measurement of previously identified factors. 
Data analysis replicated an earlier finding of three factors and also 
permitted adding test items designed to measure a possible "out-of- 
school" factor cr to more reliably measure the original factors. 

Development of an Instrument to Assess Attitudes of High School 
Students in Compensatory Programs 

MARIAN T. KILBANE, Cleveland Public Schools 

This paper describes the development of the Survey of Pupil 
Opinion, an attitude-assessment instrument adapted to the reading and 



"palatability" levels of high school students in compensatory programs. 
Preliminary testing reduced the initial pool of 100 items to an 
instrument of thirty items. Factor analysis revealed three item clusters, 
designated "social participation" (seven items), "perception of 
teachers" (nine items), and "self as student" (eight items). Test-retest 
reliability was r = .71 . Survey data from tenth-grade students in a Title I 
program indicated that the instrument differentiated among student 
groups and showed promise as a tool in identifying dropout-prone 
students. 

The Wisconsin Test of Adult Basic Education 

TEJ N. PANDEY, University of Wisconsin 

The Wisconsin Test of Adult Basic Education (WITABE) is an 
achievement instrument designed for evaluating remedial education 
programs for functionally illiterate adults. It is divided into 3 
subtests— communication, computational and coping skills. The items in 
the coping skills subtest are in unconventional mode geared specifically 
to testing illiterate adults. Content selection is based on the behavioral 
objectives of the Rural Family Development (RFD) Program at the 
University of Wisconsin. Hoyt reliability is estimated for each subtest 
and the total test. Establishing concurrent validity with the simul- 
taneous administration of ABLE and TABE, and grade equivalency 
norm study is under progress. 

An Analysis of Age, Ethnic, and Social Class Factors In A New Measure 
of Logical Thinking 

DAVID C. RAND, JOHN O. TOWLER, and JOHN F. FELDHUSEN, 
Purdue University 

A new test of logical thinking abilities based on Piagetian theory was 
developed and administered to 1200 elementary school subjects of 
varying ages, ethnic backgrounds, and socioeconomic status. The test 
was administered through the use of a color movie presentation with a 
synchronized audio tape. Analysis of the results indicated that a new, 
reliable, and relatively "culture free" test had been developed, and that 
this test did not correlate highly with traditional measures of 
intelligence or school achievement. The results also indicate that this 
use of cinepsychometrics was a practical alternative to individual or 
clinical testing programs. 

The Development and Evaluation of a Test to Measure Occupational 
Awareness 

FRANCIS J. REARDON, JOHN K.S. SENIER and JAMES P. LEWIS, 
Pennsylvania State Department of Education 

A short test of occupational awareness was developed in order to 
assess the junior high school student's awareness of the world of work. 
There were three steps in the test development. First, a large pool of 
items was developed, using information from the Dictionary of 
Occupational Titles. Following this, a panel of experts analyzed the 
item poof and gave several suggestions. Finally, a test was assembled 
and put through two phases of field testing. The final phase of field 
testing, using the actual instrument, revealed a reliability of .828. No 
floor or ceiling effects were found. The test correlates well with a 
measure of vocational maturity as well as other measures of student 
performance. 

An Application of Item-Examinee Sampling to Scaling Attitudes 

DAVID M. SHOEMAKER, Southwest Regional Laboratory for Educa- 
tional Research and Development 

The post mortem item-examinee sampling investigation described 
herein explored the feasibility of using item-examinee sampling to 
estimate scale values denoting degree of affect toward stimuli when 
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measured by the method of paired-comparisons. Results indicate clearly 
that such scale values can be approximated satisfactorily through 
item-examinee sampling. Defining one observation as the response made 
by one examinee to one item, the similarity between the estimated 
scale values and normative scale values increased generally with 
increases in the number of observations acquired by the sampling plan. 



TESTING PROCEDURES 
A Mastery-Learning Test Model 

RONALD BESEL, Southwest Regional Laboratory for Educational 
Research and Development 

A test model for analyzing criterion-referenced test data is derived. 
All individuals tested are assumed to be in either the mastery or the 
nonmastery states. Bayes formula is used to compute state prob- 
abilities. Methods for estimating prior probabilities are described. Two 
statistics or "decision variables" are computed: probability of mastery 
for an individual and proportion in mastery for an instructional group. 
The relationship between two tests is represented as an adjustment 
matrix. The interpretation of adjustment matrices in terms of instruc- 
tional effectiveness and the validation of learning hierarchies is 
discussed. 

Methodological Variables in the Study of Field Dependent Behavior of 
Young Children 

JOHN CHRISTIAN BUSCH and LAWRENCE H. SIMON, University of 
North Carolina, Greensboro 

The field dependence construct has generated a great deal of 
psychological research interest, however little methodological data are 
available on the rod and frame performance of young children. 70 Ss, 
ages 5, 6, 7 years, were administered the rod and frame. This was later 
readministered with the Lorge Thorndike Intelligence Test. Per- 
formance on the second rod and frame appeared to follow predicted 
developmental differences; split-half and test-retest reliabilities were 
significant and ranged from marginally adequate to very high; there 
appeared to be only a low and negligible correlation with intelligence. 

Cognitive Style and Creative Problem-Solving 

LEON HYER, Lehigh University; T. JEROME ROOKEY, Pennsylvania 
Department of Education 

Sn recent years three cognitive styles (Response Tempo, Response 
Style and Response Ambiguity) have been related to certain types of 
problem-solving. This investigation examined the relationships of the 
three cognitive styles to creative problem-solving. Using zero-order 
correlation coefficients it was found that Response Ambiguity related 
significantly to both measures of creativity. Response Tempo related 
significantly but negatively to creativity measure, and Response Style 
related to neither measure. A series of multiple regression analyses 
confirmed that Response Ambiguity accounted for the majority of the 
explained variance with Response Tempo minimally contributing and 
Response Style ineffective. 

Construct Validity of Creativity 

RICHARD E. STAFFORD, State University of New York, Oneonta; 
WILLIAM F. BROWNE, Ohio State University 

A self report questionnaire based on a layman's concept of 
creativity was administered to 166 male and female college students 
along with variables of convergent thinking, divergent production, 
perceptual speed and reaction time. All tests were intercorrelated and 
factor analyzed by principal components method. Four orthogonal 



factors emerged: I— convergent thinking, II— originality production, 
III— creative fluency, and IV— drive. The self report questionnaire 
loaded on factor 1 1 1 giving construct validity to this aspect of creativity. 
Sex differences are discussed. 



SYMPOSIA 

ALTERNATIVE PROCEDURES WITH OBJECTIVE TESTS: AN 
EXAMINATION OF THREE STRATEGIES 

STANLEY S. JACOBS, University of Pittsburgh, ORGANIZER 

Two persistent concerns of measurement specialists, since the 
widespread use of objective tests began about 40 years ago, have been 
methods of controlling guessing behavior and of tapping partial 
knowledge. These two consequences of the objective format and the 
usual 1-0 scoring rule fcr correct and incorrect responses have led many 
to conclude that objective item scores result in a rather crude 
approximation of person i's position on a latent continuum. 

It may be argued, of course, that this concern is another example of 
being "unable to see the forest because of all the trees," i.e., if one 
assumes a homogeneous item-set, where the probability of a correct 
response by person i (pj) is a constant across all K items, then it is a 
foregone conclusion that one should attend to the test score (pjk) and 
not individual item scores which cannot equal pj, except when Pj is 1 or 
0. While the foregoing is theoretically true, the fact of the matter seems 
to be that we do make decisions based on item responses. With the 
trend toward criterion-referenced measurement, the reliance upon 
item-scores rather than test-scores may be expected to increase. Also, 
the "homogeneity characteristic" is a thorny problem, since homo- 
geneity can be only partially attained. Thus far, the complexity of 
cognitive processes has kept ahead of the item-writer's attempts at 
developing the statistically and psychologically homogeneous item-set. 

The objectives of the symposium included a critical examination of 
the theoretical and empirical literature surrounding three methods 
which have been advanced as appropriate for increasing the amount and 
quality of information obtainable from objective test responses. The 
methods discussed, participants and paper titles were as follows: 

Alfred D. Garvin of the University of Cincinnati will discuss 
confidence-weighting of item responses in his paper titled "Confidence 
Weighting." 

Robert Rippey of the University of Illinois will discuss the 
assignment of weights to item options in his paper titled "Simplified 
Means of Confidence Testing." 

Roger Koehler, Ohio University, will discuss item-option elimination 
(Coombs'-type directions) in his paper, "Coombs'-Type Response 
Procedures." 

Ross Traub, Ontario Institute for Studies in Education and William 
Angoff, Educational Testing Service, will serve as discussants. 

It was concluded that the research evidence bearing on the methods 
discussed remains incomplete, and is in many instances equivocal. In 
the case of confidence-weighting, there seems to be some evidence that 
confidence-weighted item scores are contaminated by individual differ- 
ences in risk-taking behavior. Despite this apparent threat to validity, a 
number of studies have shown moderste-to-sizeable gains in estimated 
reliability. Option-weighting, sometimes referred to as probabilistic 
testing, remains plagued by the problem of Ss' comprehension of the 
more adequate, sophisticated scoring functions. While Coombs'-type 
directions are intuitively appealing, there seems little data favoring their 
usage. Risk-taking behaviors analagous to those which vitiate the 
"correction-for-guessing" may render obtained data difficult to in- 
terpret. 

A number of areas remain to be investigated. For example, although 
a number of writers have recommended training Ss in the usage of the 
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more complex scoring rules, to allow the development of optimal 
persona! strategies, little systematic research has been done. 

Several newer approaches designed to extract more and better 
information from objective item responses were discussed. 



AN ALTERNATIVE TO A STANDARDIZED TESTING PROGRAM 

WALTER M. MATHEWS, University of Mississippi, ORGANIZER 

The objective of this symposium is to discuss the problems school 
systems have with their testing programs, and to present as a model for 
discussion the approach that was used by the Madison (Wisconsin) 
Public Schools to redesign their system-wide testing program. Presenta- 
tions will be made by those people who had responsibilities for the 
restructuring. They will present for discussion both their successes and 
their failures— what worked and what did not work. 

For many years the Madison Public Schools had operated a fairly 
traditional standardized testing program. While much data was pro- 
duced annually it was apparent that there were problems. These 
included questions concerning (1) the relationship of the tests to the 
curriculum, (2) proper utilization of the data collected, and (3) ways 
and means of interpreting the results to parents and students. Because 
of these concerns, it seemed appropriate to re-evaluate the entire 
program. 

After some initial deliberation it was decided that total involvement 
by those who use the information from tests was crucial to building a 
meaningful testing program- In addition, it was decided that re- 
structuring a testing program was an extremely complex task. 

In order to satisfy the first requirement, representatives from each 
of the 35 schools and the various professional staffs of the school 
system were solicited to work together in developing a total testing 
program. Elementary, middle, and senior high school teachers, prin- 
cipals, psychologists, guidance counselors, and curriculum department 
members were formed into the Nucleus Committee for School Testing 
Specialists. 

Recognizing that evaluation is a sophisticated task, leadership for 
the plan was obtained from Professor T. Anne Cleary of the University 
of Wisconsin. She structured the plan in such a way that the 
participants in the program would receive training in measurement as 
well as guidance in the development of the testing program for the 
Madison Public Schools. 

Mrs. Cleary, now Director of Examinations for the College Entrance 
Examination Board, will present a paper that will describe the 
background problems of Madison's standardized testing program, and 
develop the origin of the Nucleus Testing Committee. The paper was 
co-authored by Walter M. Mathews, who was the Coordinator of 
Research and Testing for the Madison Public Schools, and is titled: 
'The Nucleus Testing Committee." 

The first task of the Nucleus Committee was to establish priorities 
for what should be measured. The Committee surveyed teachers, 
psychologists, counselors, social workers, and administrators of the 
school system to find what they needed to know about children in 
order to provide the best instructional program. Myron Seeman, the 
Coordinator of Health, Psychological, and Social Services for the 
Madison Public Schools, will present a description of the survey and the 
results that were collected from the different response-groups. His 
presentation is titled: 'The Testing Needs— Assessment." 

Three types of testing needs emerged from the survey: affective, 
curriculum-related (or criterion-referenced), and standardized norm- 
referenced. Sub-committees of the Nucleus Testfi^Corh rru ttee were 
established to investigate each area and to develop specific recom- 
mendations on both a short-term and a long-term basis. A discussion of 
the activities of these three sub-committees and a summary of their 
recommendations and progress in reference to their recommendations 
will be presented by the person who coordinated each sub-committee. 



Aiieen Nettleton, a reading consultant for the Madison Public Schools, 
will present the paper: "Recommendations: Standardized Testing." 
Peter Christiansen, the Coordinator of Mathematics for the school 
system, will present a paper titled: "Recommendations: Curriculum- 
Related Testing." Lee H. Hansen, the Coordinator of Research and 
Testing, will present the paper: "Recommendations: The Affective 
Domain." 

The administrative problems inherent in a system-wide testing 
program will be discussed by Carmelo V. Sapone, the Director of 
Curriculum Development for the Madison Public Schools. He will also 
talk about the difficulties involved in the elimination of an existing 
testing program and the institution of the Nucleus Testing Committee. 
The title of his presentation is: 'The Administrative View." 

The importance of this symposium is that it takes a long hard look 
at the traditional school district testing program, and finds it not only 
inadequate, but dysfunctional. An alternative structure is proposed, and 
the problems with, and the results from, the implementation of this 
new structure are presented for discussion. 



ANALYSES OF CONCEPT ATTAINMENT ABILITIES 

CHESTER W. HARRIS, University of California, Santa Barbara, 
ORGANIZER 

The symposium is designed to describe and present results from a 
project of the Wisconsin Research and Development Center for 
Cognitive Learning illustrating strategies for analyzing concept attain- 
ment abilities of fifth-grade students. The focus of the project is on 
developing one or more models of concept attainment abilities that 
eventually can be used as bases for suggesting instructional experimen- 
tation. The symposium describes how the focal problem was analyzed 
into problems of defining and measuring concept attainment in four 
subject matter fields at the elementary school level, problems of 
defining and measuring more general cognitive abilities that are likely to 
be related to concept attainment in the subject matter fields, and 
problems of analyzing interrelationships both within and between 
concept attainment measures and cognitive ability measures. Empirical 
results based on data for fifth grade boys and girls are used to describe 
relations among task and content aspects of measures of concept 
attainment in the four subject matter fields separately, and across 
fields. These analyses employ several factor analytic techniques, 
including three-mode analysis. Stability of the results for two different 
samples of boys and of girls will be commented on. Results for two 
different samples of boys and of girls are also available for the analyses 
of measures of more general cognitive abilities; these results add new 
evidence to questions concerning models for such abilities. Questions of 
the appropriate techniques for relating results for the concept attain- 
ment measures with those for the cognitive ability measures are raised, 
and the potentiality of inter-battery factor analysis for this purpose is 
examined. 

Mary R. Quilling, Wisconsin Research and Development Center for 
Cognitive Learning, will present the paper, "Overview of the Concept 
Attainment Abilities Project, and Discussion of the Problems of 
Measurement that Arise in* Such a Project." Mrs. Quilling will describe 
the development of items for measuring concept attainment in four 
subject matter fields. A completely crossed design, consisting of 12 
tasks and 30 concepts, was used. The tasks were constant across ail 
subject matters; the concepts differed for the subject matters, and were 
chosen in a two stage sampling plan. She will also describe the selection 
and development of cognitive ability tests assumed to be relevant to 
concept attainment. Models furnished by the work of Guilford, 
Guttman, and the Thurstones were employed in this selection and 
construction. 

Margaret L. Harris, Wisconsin Research and Development Center for 
Cognitive Learning will discuss 'Task and Content Dimensions of 
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Concept Attainment Measures for Four Subject Matter Fields." Mrs. 
Harris will describe results of factor analyses, including both conven- 
tional and three-mode procedures, for tha concept attainment items of 
the four subject matter fields. Analyses within a subject matter field 
will be compared with results of analyses of tasks and concepts across 
the four fields. The utility of three-mode factor analysis for such 
applications will be assessed. 

Chester W. Harris, University of California, Santa Barbara, will 
present the paper "Dimensions of Cognitive Abilities." Mr. Harris will 
describe the use of a "comparable common factor" strategy in the 
interpretation bf factorial data for cognitive abilities, when more than 
one sample of subjects is available and more than one factorial solution 
is employed. Results for data gathered for different samples in testing 
sessions one year apart will be presented. 

Chester W. Harris, University of California, Santa Barbara, will 
discuss "Inter-battery and Canonical Correlation Analysis as Tools for 
Relating Concept Attainment Measures and Cognitive Ability 
Measures." Mr. Harris will describe the problem of establishing a model 
for abilities common to the two types of measures. Canonical 
correlation analysis and Interbattery Factor Analysis will be compared 
and assessed for this purpose. 

Although the symposium focuses on problems of research strategy 
in a complicated area, it also reports new data on concept attainment 
and cognitive abilities; consequently, the symposium should be of value 
to persons with both methodological and substantive interests. Of 
special importance is the discussion of: the construction and analysis of 
test items in a completely crossed design, the application of factor 
analysis to such tests, the structure of concept attainment across 
subject matter fields, the use of more than one sample with the 
"comparable common factor" strategy, the new evidence on questions 
concerning models for general cognitive abilities, and the problem of 
developing a structure involving both achievement and ability measures. 

Herbert J. Klausmeier of the Wisconsin Research and Development 
Center for Cognitive Learning will discuss the papers. 



THE COLLEGE ENVIRONMENT: VARIATIONS AND COR- 
RELATES 

JOHN A. CREAGER, American Council on Education, ORGANIZER 

The objectives of this symposium are to present some recent 
developments, both substantive and methodological, in the study of the 
college environment. In this area the state of the art has progressed to 
the point that greater attention is being paid to variations in the 
environment within single institutions, and to the differential effects of 
the environment on various kinds of students. 

"Some Common and Not so Common Approaches to the Study of 
College Environments and Their Effects" will be presented by Kenneth 
A. Feldman, State University of New York, Stony Brook. Some of the 
theoretical frameworks used (either explicitly or implicitly) in the 
study of the effects of college environments are analyzed. Areas 
discussed include (1) the description and measurement of college 
environments, subenvironments, and individually experienced environ- 
ments, and (2) the measurement and interpretation of student change 
and college effects. The emphasis is on the less commonly used 
theoretical orientations— not only because of their intrinsic worth, but 
because a discussion of them throws into relief some of the underlying 
assumptions of the more commonly used approaches. 

"Open Admissions and the College Environment" is the topic of 
Jack E. Rossman, Macalester College. Attitudinal data collected from 
seniors at three campuses of the City University of New York in the 
summer of 1971 have been used to examine the impact of the advent of 
open admissions at CUNY the preceding year. The CUNY students' 
perceptions of the effect of open admissions on such variables as 
academic standards, the reputation of a college, and the value of a 



degree have been analyzed and related to the same data from seniors at 
various types of non-open admissions institutions. 

"Some Correlates of Concern for the Individual Student" will be 
discussed by Alan E. Bayer and Alexander W. Astin, American Council 
on Education. Previous research indicates that institutional coldness 
and impersonality— as manifested by low scores on a student-derived 
measure of concern for the individual student (CIS), a factor from 
Astin's analysis of the Inventory of College Activities— has a significant 
detrimental effect not only on students but also on the institution 
itself: e.g., depressed degree aspirations, greater attrition, and more 
frequent and severe incidents of unrest. Each of several sets of 
variables— measuring aggregate student characteristics, institutional 
structural characteristics, and aggregate faculty characteristics— prove to 
have high correlations with CIS. (Using stepwise multiple regression, the 
obtained Rs are, respectively, .77, .87, and .84.) Traditional measures 
of faculty "quality," however, are not positively correlated with CIS. 
After both student and institutional characteristics are controlled, 
institutions ranking high on CIS (and therefore, presumably expe- 
riencing less campus unrest as well as enhancing their students' 
aspirations and educational progress) are found not to have a higher 
than average concentration of Ph.D.s on the faculty, nor more faculty 
from the nation's "top" graduate schools, nor more faculty who are 
nationally active in their fields and more "productive" in research. 

"The 'New Student' in the Community Colleges" will be presented 
by Dorothy M. Knoell, California Community Colleges. Community 
colleges have a history of open admissions, free tuition, comprehensive 
program offerings, attractiveness to students ineligible for senior 
institutions, and high attrition at the end of the first year of study 
(usually resulting from the student's decision to withdraw rather than 
institutional action). New programs and services with state and federal 
money are changing the community college environment in ways which 
will have a lasting effect on all students. Specifically, the already diverse 
student body is more and more heterogeneous by an influx of the 
so-called "new students" to higher education, who are changing 
institutional characteristics and improving overall student performance 
significantly. 

"Variations Among Subgroups in Campus Perceptions" will be 
discussed by C. Robert Pace, University of California, Los Angeles. The 
perception of the college environment by college students may well 
exhibit variations within institutions or types of institutions. These may 
result either from actual subcultures within an institution or from 
various kinds of students perceiving their campus environments in 
different ways. The latter type of variation is summarized and 
discussed, using data from groups which have administered CUES to 
various subgroups. 

'The Use of Taxonomic Procedures to Identify Both Overall College 
Effects and Those Effects Which Interact With Student Activity" is the 
title of a paper by Donald A. Rock, Educational Testing Service. The 
purpose of this paper is to present a methodological approach which is 
designed specifically to overcome some of the problems inherent in 
identifying differential college effects. This technique is multivariate 
and is particularly relevant to the input-output model with controls on 
the input. The model affords the simultaneous use of both between 
college variation as well as within college variation. This approach 
enables the researcher to: (1) estimate the overall college effect, and (2) 
identify those types of colleges which interact with student ability. 
That is, it would seem that certain colleges may show little overall 
effects yet may do better on the average with low ability students while 
other types of colleges may do better with high ability inputs. 
Empirical data from two past studies will be presented comparing the 
results of this method with the more traditional analysis of covariance 
approaches. Variations of the method will be discussed with possible 
applications. 

The importance of this symposium lies in the fact that future 
research on college environments, their effects on students, and 
interactions with student activity will necessarily build upon these 
recent substantive and methodological developments. 
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Nathaniel L. Gage of Stanford University and Robert J. Panos, important that researchers be aware of both the promise and the 
National Computer Systems, will discuss these papers. problems of the work. 



COMPUTER ANALYSIS OF STUDENT WRITING: PROGRESS IN 
STYLE AND CONTENT 

ELLIS B. PAGE, University of Connecticut, ORGANIZER 

Since 1965 a few workers in educational research have been 
investigating the possibility of computer analysis of student prose: a 
field which ties together many theoretical and applied disciplines, and 
which promises some eventual major changes in school practice. Early 
work was largely actuarial in method, but achieved some startling 
similarity to human judgments through the use of multiple regression. 
Since then, workers have aimed at further understanding style, from a 
statistical point-of-view, and at deepening the relationship to more 
abstract work going on in computational linguistics, computer science, 
and artificial intelligence. This symposium presents methods and 
findings from very recent work done from several perspectives, treating 
both the surface structure of prose and the "meaning" behind the 
words. 

The Symposium Chairman, Dr. Ellis B. Page, is Professor of 
Educational Psychology at the University of Connecticut, and has been 
since late 1964 the director of the Connecticut research projects in 
electronic essay grading. 

The first speaker. Dr. Henry B. Slotnick, is Assistant to the Director 
of Research and Analysis for the National Assessment of Educational 
Progress, Denver. Dr. Slotnick, who did his doctoral work in computer 
essay analysis, has continued to probe the important variables in prose 
between the "proxes" of the computer counts and the "trins" of the 
deeper human variables. He has therefore investigated the "general 
qualities" which defensibly draw together the computer variables into 
meaningful, and surprisingly orthogonal, factors. The importance of 
such factors is discussed for the theoretical advancement of the work. 
His paper Is titled, "Factors and General Qualities in Student Writing." 

The second speaker. Dr. Thomas R. Knapp, is Professor of 
Education at the University of Rochester. He has analyzed certain 
National Assessment data for the influence of hand-writing in essay 
evaluation. But most recently, he has conducted large-scale experi- 
ments, assigning students randomly to three different topics (self, 
school, society) and to three different modes (narrative, descriptive, 
argumentative). His computer analysis of these effects provides new 
knowledge about how individuals may adjust their prose to changes in 
purpose. His paper is titled, "Essay Topics and Modes and their Effects 
on Student Prose." 

The third speaker, Peter I. Tillett, is currently on leave from his post 
as Director of Data Processing for the educational system of SQuth 
Australia, and is Research Assistant tc the USOE-supported research in 
essay analysis at the University of Connecticut. This work has taken 
samples of student essays from three different secondary levels, and 
from five different subject-matter areas, to explore the possibilities of 
evaluating student knowledge, as displayed in test answers. The research 
design aims at some large strategic generalities in such evaluation. His 
paper is titled, "Evaluating Student Essay Tests in Many Classrooms 
and Subjects." 

The discussant. Dr. William E. Coffman, is Lindquist Professor of 
Educational Research at the University of Iowa, and Director of the 
Iowa Testing Program, and current President of NCME. He is also 
recent author of the comprehensive review of "Essay Examinations" in 
the Thorndike edition of Educational Measurement, Thus his perspec- 
tive is fresh, informed, and broad. 

While professional costs in teaching are rising rapidly, computer 
costs per operation continue to drop at a still more dramatic rate. And 
technical advances in computer science make natural-language process- 
ing still more feasible with each passing year. Eventually, computers 
should share much of the burden of correcting student writing, and it is 



DATA ANALYSIS OF THE 1970 ELEMENTARY SURVEY OF 
COMPENSATORY EDUCATION 

JIM C. FORTUNE, University of Massachusetts, ORGANIZER 

During the past year, the analysis of the data acquired on the 1970 
Elementary Survey of Compensatory Education has been conducted. 
Data was gathered from second-, fourth-, and sixth-grade pupils, 
teachers, principals, and school districts for both Title l and non-Trtle I 
pupils and school districts. 

The objectives of the Title I symposium are multiple: (1) to 
demonstrate the historic and elementary aspects of Title I analysis; (2) 
to report on the 1970 Title I analysis the changes that were made and 
results which occurred; (3) to discuss the methodological consideration 
given to Title I analysis and what future consideration should be given. 

"Five Years of Title I Federal Evaluation" will be presented by 
Kathryn A. Hecht, University of Massachusetts. The paper will consist 
of a description of Title I evaluation from an historic perspective, 
looking at information sources, developing methodology, feedback 
utilization and other continuing issues. 

"1970 Data Collection" will be presented by Nancy Bradley, Bureau 
of Elementary and Secondary Education, U.S. Office of Education. 
The paper will describe the development of the 1970 Elementary 
School Survey: technical design, external constraints, internal needs. 

"Variable Conceptualization: A New Route to Policy Questions" 
will be presented by Elizabeth Proper, University of Massachusetts. A 
description of the interactive processes involved in the development of 
policy questions, the utilization of questionnaire information, and 
variable conceptualization will be given. 

"Development of Software" will be discussed by Stephen Edberg, 
Fredrick deFriesse, and Michael Hagerty, University of Massachusetts. 
A report on the development of the computer programs which were 
employed in the data analysis will be made. 

"Cross-Tabulation Interpretation and What Resulted," Anthony 
Com unale. Southern Connecticut State College. This paper is a report 
on how the cross-tabulation tables were interpreted by the data analysis 
staff and how information was fed to USOE, including a report on 
some of the major variables that were examined. 

"USOE's Use of Results," Joe Conner, Bureau of Elementary and 
Secondary Education, U. S. Office of Education. This paper will discuss 
bridging the gap between hypothesis and policy in legislative and 
administrative planning and action. 

"A Critique of Federal Evaluative Methodology: A Review of What 
Was Done Compared to What Should Be Done" will be presented by 
Thomas Hutchinson, University of Massachusetts. This paper will 
present a discussion of methodology as it relates to Title I evaluation. 
The following issues will be emphasized: purpose, implications or 
purpose for methodology, decision-maker validity, and identification of 
evaluative variables. 

Since the Title I data analysis constitutes a major evaluative project, 
it reflects the continuing application of methodology. Since federal 
evaluation practices represent concerns of national importance, the 
papers given at this symposium should be of wide interest. Leonard 
Cahen, Educational Testing Service, Daniel Antonopolos, U.S. Office 
of Education and David Berliner, Farwest Laboratory for Educational 
Research and Development, will discuss these papers. 



DESIGN METHODOLOGY 

DANIEL P. ANTONOPOLOS, U. S. Office of Education, ORGANIZER 

"The Need for a Design Methodology, an Overview" will be 
presented by Daniel P. Antonopolos, U.S. Office of Education. 




85 



96 




A methodology other than that used for research may be more 
appropriate for educational engineering and development projects and 
programs. This symposium compares the purposes and methodologies 
of research and of design and concludes that while their purposes are 
different, their current methodologies are the same, calling attention to 
the need for new design methodological strategies. 

The research or scientific methodology with analysis as its hallmark 
is demonstrated in this symposium as more often restricting the 
effectiveness of a design solution. To achieve an effective design 
solution, a methodology distinctly different from the research 
methodology is advocated, theoretically identified, and illustrated in 
terms of new empirical applications as an example of a design 
methodological option. 

Reporting on design methodology developed by Gerald Nadler, 
Professor of Engineering, University of Wisconsin, and research in- 
cluding studies which attempted to delineate the actual strategies used 
by outstanding professionals in various fields, the papers call attention 
to the finding that such experts although in different fields have strong 
similarities in steps of the stragegy each used. The application of a 
ten-step design strategy utilizing function determination and ideal 
systems development as hallmarks are represented as one approach 
showing better results than some conventional strategies based on 
research methodology. This new design strategy, its explication, 
application in the physical and social sciences, and implications for 
training requirements of "designers", "developers", "evaluators", and 
others, are presented and discussed in this symposium. 

'The Ideals Systems Concepts" will be presented by Gerald Nadler, 
University of Wisconsin. Research on how to do research and how to 
design is a growing endeavor all over the world. The total range of 
specific fields which contribute to or deter research and design involves 
psychological, sociological and organizational factors as well as available 
educational, economic, and natural resources. 

Designing, the art of making plans, structuring patterns or models is 
often the way useful results are obtained using the knowledge, laws, 
and theories developed from research. More precisely, design is the 
multi-dimensional (physical, state, control, interface and rate) specifica- 
tions of the precise conditions for each of the characteristics (functions, 
inputs, outputs, sequence, environment, catalysts and human agents) of 
a system. 

Research has a well founded approach or methodology. This is not 
the case for engineering, developing or designing. When a step by step 
approach for design is taught, the research methodology is generally 
given. This in effect assumes that the same approach is desirable for 
both purposes. 

In the briefest format, the research approach has the steps of 
observation and/or a library search, hypotheses, experimentation and 
conclusion. This plan of attack has analysis as its hallmark. 

The engineering or design approach when made explicit, is almost 
identical: (a) identify the problem for which a single system or product 
is required; (b) subdivide the problem into its components to uncover 
any new elements of the problem which would alter the design 
specifications; (d) recombine the components into the desired system 
or product. 

The steps vary slightly in texts on engineering, in design or solution 
oriented fields like operations research, management science, systems 
engineering, architecture, and others concerned with a specific answer 
or solution for a specific problem. 

Although different words may be used the design steps or process 
suggested are called the "scientific method" or "problem solving 
method." 

What is surprising about the sameness in the research and design 
methodologies is that while their purposes are different, the two 
approaches have been historically treated as one. 

This paper deals with an alternative option for design methodology 
called the Ideals System Concepts. 

IDEALS, an acronym for ideal design of effective and logical 
systems includes three basic ideas: a prescriptive, universal definition of 



system, an effective strategy for design, and a program for continuing 
systems design and improvement in any organization. By definition the 
Ideas Concept is a design strategy and organized program applicable to 
present and contemplated systems for the purpose of formulating the 
most effective system for achieving a set of desired functions. 

A system is defined and described in this presentation as the 
specified and organized conditions for the elements of function, inputs, 
outputs, sequence, environment, physical catalysts, and human agents, 
detailed in physical, rate, control, interface and state dimensions. The 
interrelationships of the above are represented as giving structure to a 
design matrix and the strategies for representing boundaries or the 
solution space of a problem, project, subsystem or system are discussed 
in detail. 

"Applications of the Ideals Systems Concept Design Methodology" 
will be discussed by James T. Johnston, Apollo V and Ideals Systems, 
Inc. The applications of the Ideals System Concept in a variety of 
problems and settings will be described and discussed. Included are the 
curriculum design and development of a New College; designing and 
structuring a government educational research program, and the design 
of the University of Wisconsin Medical Center. 

"Design Methodology: Implications for Training Researchers, 

Developers, Evaluators and Others" will be discussed by William J. 
Gephart, Phi Delta Kappa International. Based on the well accepted 
principle in architecture that "form follows function," the program for 
training the design methodologist cannot be the same as the program 
for preparing the research methodologist. This symposium asserts and 
reasons that research and design serve different functions, therefore 
they are of different form. 

To develop the educational program for the design specialist 
curriculum planners are advised to employ the proposed design 
methodology with consideration of the. following two imperatives: 
(1) the adequate program for design methodology cannot be expected 
to be a collection of courses from different specialties (2) any program 
being implemented ought to be considered as the best plan to date with 
the specification of procedures for evaluating its process and product 
and for making changes to improve its product. 

These papers will be discussed by James Pophum, University of 
California, Los Angeles; Robert L. Baker, Southwest Regional Labora- 
tory for Educational Research and Development; Richart Otte, U.S. 
Office of Education; and Roy Forbes, U.S. Office of Education. 



DIAGNOSIS AND PLANNED CHANGE OF REASONING LEVELS 
AND SKILL ACQUISITION THROUGH THE USE OF A 
CRITERION-REFERENCED, THEORY-BASED INSTRUMENT 

DAVID H. FELDMAN, Yale University; WILLIAM M. BART, Uni- 
versity of Minnesota, ORGANIZERS 

In recent years there has been increasing demand for measurement 
techniques that do not depend on the normative assumptions of current 
achievement and ability measures. Rohwer (1971), for example, in his 
recent review of the relationship between cognitive development and 
education, gave considerable emphasis to the need for assessment 
devices which are based on the theoretical contributions of Bruner and 
Piaget. Rohwer also emphasized the need for instruments based on 
criterion-referenced testing and task analysis conceptions, such as those 
of Gagne and his colleagues. The proposed set of papers reports 
progress made on the development of an assessment technique which is 
derived from cognitive development theory, primarily Piaget's, and is 
also influenced by the task analytic work of Gagne. The instrument is 
intended to permit diagnosis of both general reasoning level develop- 
ment, in Piaget's terms, and the specification of skill attainment in 
relation to a valued criterion. 

"Map Understanding in Cross-Cultural Perspective: Malawi, Africa" 
will be presented by T. A. Mast, University of Minnesota, S. R. Lawless, 
Soche Hill College and D. H. Feldman, Yale University. This paper is a 
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report of a cross-cultural study comparing 160 Malawi, Africa children 
with previously reported data for Chinese, Black and White children in 
San Francisco, California and St. Paul, Minnesota. A number of 
opportunities were exploited in the study. First, it provided an 
opportunity to test the applicability or validity of the map understand- 
ing test in a different culture. Second, the study allowed us to gather 
data bearing on Piaget's assertion that cognitive development takes 
place in an invariant sequence of stages, regardless of the cultural 
setting in which cognitive development takes place. Third , we were able 
to compare the effects of years of schooling versus years of age in 
cognitive development; that is, the East African children often started 
school later and were thus several years older than their American 
counterparts (e.g., a child who was in the sixth grade might be 13 or 14 
years old in Malawi, while virtually all children in this country are in 
the sixth grade at 10 or 11 years). The results of the study suggested 
that there are limits to the usefulness of the map understanding test in 
another culture. They also support Piaget's invariant stages assumption, 
but limitations of the instrument prevent a definitive statement on this 
matter. The most significant finding was that years of schooling and 
years of age interact in producing reasoning levels among children. Our 
instrument predicted, in many cases, that African children would be 
responding for the most part at a concrete level, while in fact a majority 
of the African children were responding formally. This finding suggests 
that the children had, through their experience outside of school, the 
ability to develop structures for formal reasoning about maps. Or, 
alternatively, they were better able to utilize school instruction in the 
formation of such concepts than younger, same-grade peers in America. 
Finally, the study provided little support for the belief that individuals 
in primitive cultures develop through the same set of stages in cognitive 
development but do not reach as high a level as in more industrialized 
cultures. If anything, the results suggest that the African children were 
able to achieve formal reasoning of a more complete sort with respect 
to map understanding than their American counterparts with the same 
number of years of schooling. As indicated above, however, this result 
may be due to the increased age of the Malawan subjects. 

"A Multilinear Ordering of Map Understanding Tasks" will be 
presented by K. Lele and W. M. Bart, University of Minnesota. This 
paper reports a reanalysis of the original San Francisco data (N = 270, 
90 each of White, Chinese, and Black children) using a new technique 
for determining multilinear sequences. For this project the map 
understanding test data collected by Feldman and his associates and 
reported by Feldman (1971) and Feldman and Markwalder (1971) was 
analyzed using ordering theory procedures (Airasian and Bart, 1971; 
Bart & Kruse, in press). Ordering theory has, as a primary intent, the 
generation of hierarchies (or multilinear orderings) for sets of tests 
items or tasks that can be dichotomously scored. With the use c«f an 
ordering theory computer program developed by W. Bart and K. LeJe at 
the University of Minnesota, the multilinear orderings for the twenty- 
five map understanding tasks for three ethnic groups (Chinese, Negro, 
White) were analyzed to determine cognitive patterns that are 
(1) common across ethnic groups and (2) unique to each of the ethnic 
groups. Comparison was made between the multi-linear orderings which 
account for between 95 to 100 percent of the map understanding test 
response patterns and Gutt man's Scale results for the same data. A 
discussion is included indicating other possible applications of ordering 
theory techniques for cognitive development research. 

The third presentation, by V. K. Gray, University of Minnesota and 
D. H. Feldman, Yale University, is titled "Group versus Individual 
Analysis of Spatial Reasoning in Three Ethnic Groups." In this paper 
some questions pertaining to the validity of the Map Understanding 
Instrument were asked. These questions pertain to the applicability of 
previously reported group findings to the individual children within 
these groups. The argument underlying the paper is that the educational 
usefulness of diagnostic information must be applicable to individuals; 
the study was inspired by reanalysis of other group data which had the 
same concern (Feldman & Johnson, 1971). There were two parts to the 
reanalysis. First, the protocols of individual subjects who made up the 



various group results reported n previous studies were compared with 
their group pattern. The results of this reanalysis indicated that 
individuals, for the most part, had similar patterns of responses to their 
groups, in contrast to the Feldman and Johnson (1971) reanalysis of 
Lesser's patterns of mental abilities. As in the Lesser reanalysis, 
however, there was some variability in results depending on the 
particular technique used to match individuals to their group pattern. 
The second phase of the reanalysis utilized a hierarchical clustering 
computer routine presented by Feldman (1967) and adapted for 
present study by V. K. Gray of the University of Minnesota. The 
purpose of this cluster analysis was to determine if natural clusterings 
of individuals would occur, given the validity of the individual 
distributions of reasoning level responses. The results of the clustering 
analysis indicated that there were four groups into which the subjects 
tended to divide themselves with a small number of subjects falling into 
a fifth, undetermined, group. These groupings are compared with the 
results using ethnicity, grade and sex categorical variables of previous 
studies. 

The final paper is "Diagnosis of Susceptibility to Reasoning Level 
Change" by W. E. Markwalder, Southern Mississippi University and 
D. H. Feldman, Yale University. The purpose of this experimental 
intervention study was to determine if the map understanding 
instrument could be used to diagnose readiness for reasoning level 
change. A pilot study using the Feldman-Salomon ranked distractor 
technique indicated that Variation Score (a 5 weighted index of 
variability of response across reasoning level stages) was positively 
correlated with degree of reasoning level change among fourth, fifth, 
and sixth grade subjects over a 12-week period. In the present study, 
the instrument was administered to three fourth-grade and three 
sixth-grade classes on a pre/post basis with a 12-week interval between 
administrations. Subjects were categorized as transitional or stable on 
the basis of their pretest Variation Scores and assigned to one of three 
groups; a control group receiving a placebo; a treatment group receiving 
an intensive cognitive training session; and a second treatment group 
receiving artificial time pressure during the post-test administration. 
The treatments were applied one week prior to post-testing. It was 
hypothesized that subjects with high Variation Scores show greater 
change from pre to post-test than stable or low VS subjects. It was 
further predicted that the modal response level of high VS subjects 
receiving a treatment would be plus or minus one stage from their 
pretest modal response level, depending on whether the treatment was 
the cognitive enhancement or time pressure treatment. Results are 
discussed in terms of the utility of the instrument for diagnosing 
readiness for reasoning level change within the context of attainment of 
school tasks. 

David R. Olson of the Ontario Institute for Studies in Education 
will serve as discussant. 



DIFFERENTIAL OPTION WEIGHTING 

GERRY F. HENDRICKSON, Johns Hopkins University, ORGANIZER 

Differential weighting of items or options has long been studied by 
researchers and employed by practitioners. Recently differential 
weighting of item options using a technique described by Guttman has 
received much attention. It is the purpose of this symposium to explore 
this technique in detail. The first paper presents the mathematical 
foundations of Guttman's scheme acid discusses a computational 
technique. The next paper presents an empirical study showing the 
effect of this type of option weighting on test reliability and validity. 
The following two papers discuss the effect of Guttman weighting on 
the correlation of weighted and unweighted test scores and on the 
factor structure of the test, respectively. The final paper describes a use 
of this type of differential weighting. 

'The Relation of the Method of Reciprocal Averages to Guttman's 
Internal-Consistency Scaling Model" will be presented by Frank B. 
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Baker, University of Wisconsin and Cyril J. Hoyt, University of 
Minnesota. A scaling technique known as the Method of Reciprocal 
Averages has been in use since the early 1930's. This technique yields a 
set of item response weights for a psychological inventory which 
maximizes the internal consistency of the inventory for a group of 
subjects. Although the technique has been used for many years, its 
mathematical foundations have not been made explicit. In the present 
paper it is shown that the informal data processing procedures of this 
technique actually solve the set of linear equations yielded by 
Guttman's Least Squares Model for internal-consistency scaling. The 
constraint imposed by Guttman to insure that the solution yields a 
nonextraneous set of weights is also met. From a computational point 
of view the Method of Reciprocal Averages has an advantage over the 
principal components approach employed by Guttman's solution as it 
does not require the calculation of an item response category 
co-occurrence matrix. In addition, the Method of Reciprocal Averages 
can be implemented as a simple extension to existing item analysis 
computer programs. 

"Effects of Item Option Weighting on Validity and Reliability of 
Shortened Forms of the GRE Aptitude Tests" will be discussed by 
Richard R. Reilly and Rex Jackson, Educational Testing Service. Item 
options of shortened forms of the GRE Verbal and Quantitative 
Aptitude Tests were keyed using the Guttman scaling procedure. A 
double cross-validation design was employed with samples A and B each 
consisting of 2,500 sets of item responses from the December, 1970 
GRE administration. The samples were divided by randomized-blocking 
on total GRE score. For each test form two separate keying procedures 
were used. The first, designed to maximize coefficient alpha, keyed 
each item using as a criterion the scores on the m-1 remaining items, 
while the second maximized parallel forms reliability. Cross-validated 
reliabilities and intercorrelations were examined and compared with 
results obtained using formula scores. The factor structures of each test 
before and after option weighting were also compared. 

In a second phase of the study the validities of weighted versions of 
the tests were compared with formula score validities. Overall grade- 
point average in college served as the criterion in the following sample. 
Because grades were collected from a number of institutions varying 
considerably in quality, data were pooled using a "central prediction" 
method due to Tucker (1963). Within school correlations were also 
computed. 

'The Sensitivity of Guttman Weights" will be presented by Bert F. 
Green, Jr., Johns Hopkins University. Test scores that are weighted 
sums of dichotomously scored items correlate very highly with 
conventional test scores (unweighted sums of dichotomously scored 
items). Weighting item options differentially provides a different test 
score, which will probably correlate less highly with the conventional 
test score, but the correlation may still be too high to make weights 
profitable. Limits on this correlation will be presented, and some 
examples will be presented. The implications for the sensitivity of the 
dividual weights will also be examined. The sensitivity of Guttman 
weights will be characterized by comparing variants of the weighting 
scheme with respect to the criterion used in deriving the Guttman 
weights (the maximum between-item variance). 

"Comparison of the Factor Structure of a Guttman-scored vs. a 
Rights-only-scored Test" will then be discussed by Gerry F. Hend- 
rickson and Bert F. Green, Jr., Johns Hopkins University. It has been 
shown that Guttman weighting of test options results in marked 
increases in test reliability. However, the effect of this type of 
weighting on the structure of the test is not known. Hence, the purpose 
of this study is to compare the factor structure of Guttman-weighted 
and rights-only-weighted tests and to relate, if possible, the change in 
structure to the change in reliability. The tests used were all four 
subtests of the Scholastic Aptitude Test. Items of each subtest were 
intercorrelated and the resultant matrices factor analyzed, first weight- 
ing with Guttman then with conventional weights. 

More variance was accounted for by the first several factors of 
Guttman-weighted tests than by these same factors in conventionally- 



weighted tests. Also, the tests for which there was most increase in 
variance were the ones for which there was greatest increase in 
internal-consistency reliability. Finally, the factor structure of Guttman 
and conventionally weighted tests was quite different; that is, items 
loaded on different factors in the two cases. 

Finally, Fred Pyrczak, Jr., of California State College, Los Angeles 
will present the paper, "Objective Evaluation of the Quality of 
Multiple-Choice Test Items by Means of Differential Choice Weighting." 
In the past, attempts to measure item quality have made use of 
subjective judgments, indices of item difficulty, and indices of 
item-choice correlation with a criterion variable. 

Davis (1950) originally proposed the use of information provided by 
item-choice weights to evaluate item quality. Following his proposal 
two new indices have been developed to assess item quality. The first 
index was designed to indicate the extent to which a given item 
differentiates between those who know the answer and those who do 
not. The second index was designed to indicate the extent to which the 
distracters differentiate among those who are either misinformed or 
partially informed. 

The validity of the new indices was determined using judges' ratings 
of the quality of multiple-choice items as the criterion. A special set of 
items was written illustrating three levels of each of nine important 
characteristics of multiple-choice items, and a guide list of critical 
points to be considered in evaluating the quality of multiple-choice 
items was prepared for use by the judges. The validity of the new 
indices for measuring item quality is compared with that of conven- 
tional item-analysis data. 

It is hoped that this thorough, integrated presentation (examining 
mathematical foundations, an empirical study, some effects and a use 
of differentia! option weighting) will provide a framework for further 
research. This framework will be especially valuable to those interested 
in actually implementing this weighting scheme. 

Fredrick B. Davis, Test Research Service, will serve as discussant. 



DO WE PRACTICE WHAT WE PREACH? ARE SYSTEMATIC 
RESEARCH, DEVELOPMENT, DIFFUSION AND EVALUATION 
STRATEGIES BEING USED IN ESTABLISHING RDD&E TRAINING 
PROGRAMS? 

SUSAN S. KLEIN, U.S. Office of Education, ORGANIZER 

This symposium is designed to help RDD&E program planners, 
trainers, students and employers identify if and how RDD&E strategies 
or tools can be used in the design and implementation of RDD&E 
training programs. The specific objectives are: 1)to review the 
implications of recent OE funded research for the training of RDD&E 
personnel; 2) to identify additional research needed on the training of 
RDD&E personnel; 3) to describe how development strategies have 
been used in selected R&D training programs; and, 4) to present some 
strategies which may be used to diffuse successful RDD&E training 
materials and programs. 

Susan S. Klein, US. Office of Education will present "Overview: 
Use of RDD&E Strategies by the Research Training Branch of 
NCERD,OE." The Research Training Branch is attempting to use and 
encourage the use of RDD&E strategies to develop, strengthen and 
implement educational R&D training programs. Research activities have 
included reviews of literature on RDD&E, the identification of skills 
used by R&D personnel, descriptions of educational training programs 
and a design study to determine employer needs for RDD&E personnel. 

Various types of development strategies are being used in the 
materials development, consortia, and new model programs. Some of 
these strategies are more systematic than others. All of the OE funded 
Research Training programs are required to have internal or formative 
evaluation components. Systematic summative evaluation plans are in 
early stages of development. A RDD&E communications center has 
been conceptualized to help with the dissemination of educational 




RDD&E information and training materials, but the operational 
mechanism still needs to be established. 

Henry L. Ammerman, Teaching Research, will discuss "Research 
Implications from the Oregon Project; The Generation of Information 
to Support Long-term Manpower Studies of Planning for Training 
Programs in Educational RDD&E." The data from this study, collected 
from 20 case studies of exemplary RDD&E projects, provides an initial 
mapping of the domain of educational RDD&E. Implications for 
educational R&D personnel training can be derived from examining the 
empirically based framework incorporating the following conceptual 
sets: Definitions, Interactions, Mechanisms, Outputs, Operations, 

Inputs and Organization. 

"Research Implications from the AERA Task Force Project: A 
Study of Research and Research-Related Personnel in Education and 
Procedures for Facilitating and Improving the Training of Such 
Personnel" will be presented by Blaine R. Worthen, University of 
Colorado. Major objectives of this study include: 1) determination of 
the functions, tasks, skills and knowledge required of educational R&D 
personnel; 2) the development of instruments to assess R&D compe- 
tencies; 3) an inventory and description of current educational R&D 
training programs; 4) an updating of the Clark-Hopkins personnel 
projections based on funding levels; 5) a synthesis of existing personnel 
studies based on non-financial projections; and 6) a synthesis of existing 
studies of RDD&E personnel. 

"Future Research Strategies to Improve Educational RDD&E 
Training Programs" will be discussed by Paul D. Hood, Far West 
Laboratory for Educational Resjarch and Development. Various types 
of research efforts are needed to improve educational RDD&E training 
programs. Some research needs arise from logical questions about 
employment needs and functions of RDD&E personnel, instructional 
methodology, or operational program strategies. Others arise from 
political demands often related to society in general. Most research 
efforts have focused on non-political substantive issues. However, it is 
possible that empirical research on political issues would benefit the 
RDD&E program decisions as well. 

Then, Joseph Ward, Far West Laboratory for Educational Research 
and Development, will present his paper, "Development Strategies Used 
by the Far West Consortium for DD&E Training". The Far West 
Consortium has been developing planning and design course modules 
and assessment instruments on "Listening and Speaking," "Informa- 
tion/Data Collection," 'The Consideration of Alternatives," and 
"Statistics." Development strategies are also being used in the overall 
Consortium Management, Engineered Internship, Personnel Systems, 
etc. 

Finally, John E. Hopkins, Indiana University, will discuss "Evalua- 
tion of Educational RDD&E Training Programs". Procedures used to 
determine how the RDD&E training programs are meeting the desired 
objectives will be examined. Specific attention will be given to the 
evaluation of the three R&D training consortia. 

The use of the research, development, diffusion and evaluation tools 
should not be unique to the establishment of educational RDD&E 
training programs. In fact, people involved in RDD&E training 
programs should have greater command of RDD&E skills and thus 
establish exemplary programs using the RDD&E processes. 

John C. Egermeier and Cora P. Beebe of the U.S. Office of 
Education and Arliss Roaden of Ohio State University will discuss the 
presentations. 



EVALUATION OF PERFORMANCE CONTRACTING: EMPIRICAL 
FINDINGS AND OBSERVATIONS 

MILTON D. JACOBSON, University of Virginia, ORGANIZER 

Accountability and its handmaiden, performance contracting, are 
very much on the contemporary academic scene with pro's and con's 
about it emanating from all quarters— lay, professional and union. 



The objective of this symposium is to present empirical findings by 
those who were in 1970-1971 responsible for performance contracting 
experiments and projects, including the O.E.O. study and the Virginia 
project, two of the largest experiments in performance contracting to 
date; by those who have developed performance contracting programs; 
by those who evaluated pupil, teacher and project performance, and by 
those who assisted school systems in the management of performance 
contracting. 

Differing and sometimes conflicting points of view based on 
empirical data are presented with evaluative perspective by the 
participants who represent the spectrum of "involved" agencies: state 
departments of education, local school districts, instructional con- 
tractors, evaluation and management specialists. 

Dr. Milton D. Jacobson, Director of the Bureau of Educational 
Research at the University of Virginia chairs the symposium, presenting 
an overview of performance contracting, summarizing the presentations 
by those who evaluated pupil, teacher and project performance; and by 
public education. 

Dr. Horace W. Ray, Fellow at Battelle Memorial Institute presents 
the results of Battelle's analysis of the impact of performance 
contracting on student achievement in the OEO Performance Incentive 
Remedial Education Experiment. Both first- and second-year achieve- 
ment test results are presented. I n addition the design, objectives and 
the scope of the OEO experimental study are described. His paper is 
titled, "Impact of Performance Contracting on Student Achievement in 
the OEO Performance Remedial Education Experiment." 

Dr. Robert V. Turner, Special Assistant to the Superintendent of 
Public Instruction in the Virginia State Department of Education 
discusses the Virginia Performance Contract in Reading, presenting the 
history, procedures and outcomes of this the first state-wide effort in 
performance contracting. Hard and soft data findings are summarized 
across grade levels, and the program is conceived as a model that 
provides for total involvement of all staff, for individualization of 
instruction and program, and for accountability. His paper is titled, 
'The Virginia Performance Contract in Reading." 

Dr. Paul Bell, Director of Instruction for Dade County, Florida 
relates how the Dade County public schools, with representatives from 
local professional organizations, the Dade County Administrators 
Association, and representatives from the Title I (Elementary and 
Secondary Education Act) parent and student advisory council, have 
been planning since March, 1971 for the implementation of a 
performance contracting project. These plans for performance contract- 
ing are based largely on pursuing three major areas of concern: 
(1) increasing the curricular and instructional change potential; (2) in- 
creasing the potential for participatory management of teachers; and 
(3) maximize cosl-effectiveness in improving students' basic skills. 

Dr. Bell explains that these concerns are being explored through the 
application of a portion of Title I funds to performance contracting in 
interna! (teacher) and external (private sector contracts). The school 
system's approach to performance contracting is based upon a unique 
definition of "accountability": a management concept based on the 
principle of management by exception, whereby goals are defined into 
specific objectives and criteria for measuring success are determined 
through a participatory management process involving students, 
teachers, parents, and administrators under the proposed program. 
Decisions regarding programmatic areas such as curriculum and 
methodology are reflected to a great extent by the recommendations of 
the lowest operations unit, the individual school faculty or the 
classroom "contractor." Financial resources and logistical support are 
provided to those operating units which accept responsibility for 
accomplishing a greater number of objectives or a given number of 
objsctives at a higher level of student proficiency. 

He reports that the program has as its long range objective: (1) to 
significantly increase the achievement of Title I eligible students, grades 
3-6 in math and reading; (2) to significantly increase the attendance 
behavior patterns related to students' academic success in the class- 
room, including increased attendance rates and improved student 



attitudes toward professional staff, to peers, and to the school 
community in general; and (3) to demonstrate the feasability of 
utilizing the new concept of risk capital and incentive bonuses and 
incentive contracting for increasing the achievement of Title I eligible 
students, grades 3-6. 

By providing opportunities to contract with both interested faculty 
groups and with external private sector groups, the school system hopes 
to identify a cost effectiveness, instructional program which can be 
installed in schools serving similar target populations which will result 
in improved student performance. 

The Dade County School Board is initiating this project as part of 
its overall objective to introduce accountability into instructional 
programs. His paper is titled "Performance Contracting— A Systems 
Approach". 

Dr. Brian Frieder, President of Alpha Learning Systems presents a 
review of the problem of evaluation of performance contracts, discusses 
the particular unknowns that are crucial to performance contracts as a 
sound business venture, and then suggests some solutions for the future 
of performance contracting from the instructional contractor's point of 
view. His paper is titled, "Evaluation of Performance Contracts from a 
Business Perspective." 

Dr. Charles A. Woodbury, Jr., Associate Professor in Education at 
the University of Virginia cites recommendations for evaluation in 
performance contracting, from an a posteriori viewpoint based on 
assessment of pupil achievement and effective outcomes in 24 
experimental and control schools. Observations and findings are cited 
regarding involvement of the evaluator, test selection, administration 
and security, achievement standards, effective measurement, and 
programmatic design. His paper is titled "Evaluation in Performance 
Contracting: an a posteriori View". 

Mr. Charles L. Blaschke, President of Education Turnkey Systems, 
Inc., discusses the program planning, development, implementation, 
monitoring and economic analysis techniques which have been used in 
projects such as the 0E0 and the Virginia experiments. Considerable 
emphasis is placed on the COST-ED Model as a tool for budgetary 
planning, program design, simulation, and collective bargaining. His 
paper is titled, "Program Planning Development, Implementation, 
Monitoring and Economic Analysis Techniques in Performance Con- 
tracting." 

Because performance contracting is a pioneering effort, experiences 
by those who have participated in this educational innovation should be 
shared with others as guidelines to the introduction, execution and 
adjudication of this instructional approach and effort. 



EVALUATION PROSFECTIVES: A FOCUS ON CURRENT GAPS 

LEON JONES, Governors State University, ORGANIZER 

The objectives of this symposium are to present an evaluation 
perspective on: 1) theoretical gaps, 2) methodological gaps, 3) practical 
gaps. 

Jimmie C. Fortune of the University of Massachusetts will present 
the paper "Problems Facing the Evaluator of Social Action Programs". 
For the most part, program administrators operate all programs in a 
similar manner irrespective of the nature or purpose of the program. 
With few notable exceptions, social action programs are operated in a 
traditional way without much thought being given to their aims and 
objectives. In fact, administrators go on from year to year sometimes 
changing somewhat the work they do but without clearly formulating 
a basis for their program of delivery. This being a necessity has a 
profound influence on the quality of service they render. 

This condition may explain why it is entirely possible for public 
schools' evaluations to be meaningless. There may be a relationship 
among the degree of strength of social action programs, evaluation 
methodology, and the training provided in institutions for both 
administrators and evaluators. 



Suffice it to say that problems facing the evaluator of social action 
programs are not unique. In fact, the problems facing the evaluator of 
social action programs fit within the operational framework of those 
problems encountered in the evaluation of ongoing programs. Evalua- 
tion, like other scientific disciplines, should operate via logical 
deductive principles. 

Thomas E. Hutchinson, also of the University of Massachusetts, will 
discuss "Some Overlooked Implications of the Purpose: to Provide Data 
for Decision-making." Some evaluation methodology has been 
developed for the purpose of providing data for decision-making. 
Unfortunately not all of this methodology has attended to some 
important implications of this purpose. The purpose is fulfilled if, and 
only if, the data provided is actually used in the decision making 
process. To the extent that (a) the evaluation produces data that is not 
used, that evaluation is wasteful; and (b) the evaluation produces no 
data for some decisions that need to be made, it is incomplete. 

More importantly, however, rt is necessary to take account of the 
fact that decision-makers are real people. If the person or persons for 
whom the data is collected do not believe in the utility of the data 
provided they will ignore that data, the evaluation resources used to 
generate that data will have been wasted, and the purpose for the 
evaluation will have failed. An evaluation methodology that does not 
assure that the data will be used does not accomplish the purpose: to 
provide data for decision-making. 

Some specific implications of the above for evaluation methodology 
are as follows: the goals evaluated should be the decision maker's goals 
for the enterprise, the variables measured should be those of concern to 
the decision maker, the observational techniques that are used should 
possess decision-maker validity, and so on. 

Leon Jones, of Governors State University, will then present "A 
Methodological Gap Regarding the Completeness Aspect of a Goal 
Intent." The area of methodological research and the investigations of 
methods of data collection and analysis have striven for many years. It 
appears, however, that even if all evaluators and prospective evaluators 
were ready to adopt the most efficient evaluation procedures, there 
would be no adequate combination of existing methodology for them 
to use. 

By methodological gaps, the writer means the absence of a set of 
procedures or methodology that enhances the understanding and/or 
mastery of an evaluation problem or issue. It is noteworthy that, to a 
great extent; methodological gaps have not yet been articulated and/or 
publicized on any wide scale. The gaps considered in this paper do not 
span the entire evaluation area, however. 

Two important methodological concepts from a theoretical point of 
view are consistency and completeness . In practical respects, the 
consistency aspect can be established without much difficulty. The 
attainment of completeness implies the attainment of consistency. 

Robert E. Stake, University of Illinois will discuss "An Approach to 
Problems Facing the Evaluator of Instructional Programs." The 
problems that the evaluator of instructional programs faces includes 
levels of evaluation. Essentially, there are two levels of evaluation— high 
and low. in the case of high level evaluation, it makes sense to expect 
results that are generalizable. A low level of evaluation would be more 
conclusion-oriented. These levels fit comfortably within the framework 
of the traditional notions of summative and formative evaluation. 
Formative evaluation approximates the low level as used here. 

There are more ways than one to evaluate instructional programs. 
Formative evaluation offers no panacea to the problem facing the 
evaluator of instructional programs. In fact, formative evaluation 
emphasized variation in the characteristics of the outcome. Such 
variation adds to the complexity of the problems. The evaluation of 
instructional programs has to be a complex process, however. In the 
field, in the classroom, even using the best of the anthropologist's skills, 
we cannot detect the ingredient that is present in optimum proportion; 
we cannot tell what is active and what is inert and what is catalytic; we 
cannot tell what is causing what. The natural variation and covariation 
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is too infrequent and capricious to be a dependable basis for 
generalization. 

Finally, Blaine R. Worthen, of the University of Colorado, will 
discuss "Decision-making in the Absence of Information." If a 
fundamental purpose of evaluction is to assist decision-makers in 
making logical decisions, then decision-making in the absence of 
information can be considered by looking at changes that take place 
without evaluation. 

It is unfortunate that more often than not the only correct method 
of prediction is "hindsight" prediction. "Hindsight" prediction can best 
be described as reliability indicators based on the nature of what has 
occurred. Usually, decisions made in the absence of information possess 
some of the ills of "hindsight" prediction. They lack the outcome that 
the application of a system of appropriate strategies could offer. 

If education is to move forward, then it must move away from the 
most popular and most successful of all prediction techniques— 
hindsight prediction. The thirst for education to move forward suggests 
new changes. Evaluation provides an alternative way for decision- 
makers to meet the challenge of change in the absence of information. 
This can be accomplished by (a) determining the existence of dis- 
crepancies and (b) using discrepancy information to identify 
weaknesses. 

This symposium is scientifically important to the field of education 
to have an operational concept of evaluation presented as a form of 
decision-maker oriented research. It is educationally important to have 
a series of current evaluation gaps identified and articulated by 
professional educators. This importance will be amplified somewhat by 
the presentation of a viable evaluation perspective relative to some of 
the gaps. It is educationally important in its own right to have a 
symposium made up with participants, whose evaluation discipline and 
orientation differ markedly, treat a common topic. 

David C. Berliner of the Far West Laboratory for Educational 
Research and Development, Leonard Cahen of Educational Testing 
Service, and Bruce W. Tuckerman of Rutgers State University will act as 
discussants for these papers. 



IN DEFENSE OF TYPE III ERRORS: FORTHRIGHTLY 

FRIVOLOUS, FREQUENTLY FARCICAL FANTASIES IN 

EDUCATIONAL RESEARCH, DEVELOPMENT AND EVALUATION 

W. JAMES POPHAM, University of California, Los Angeles, 
ORGANIZER 

Members of any research and development community should take 
their mission seriously, but they should not take themselves too 
seriously. There are therapeutic dividends to be gained from chuckling 
at our own shortcomings. This symposium is designed to present such a 
humility-inducing experience for both the participants and the 
audience. It is, in essence, a reprise of the highly successful symposium 
(employing mirth-production as the criterion) staged two years ago at 
the annual AERA meeting in Los Angeles. On that occasion, in a 
symposium entitled "Empirical Sediment in Educational Research," a 
group of seasoned researchers shared with the audience a series of 
methodological and conceptual errors they had committed during their 
careers. The symposium had been sporadically formulated for almost 
two years under a less pretentious title of the Blooper symposium. The 
session was, by consensus reports, a riot. As a change of pace from the 
typical heady fare of an annual meeting, 3 session designed chiefly for 
fun provides welcome relief. 

Nonetheless, one cannot overdo a good thing. An annual comedy 
blast might prove tiresome. After a year's layoff, however, it is time for 
the latent satirists to emerge. A new effort has been planned to 
entertain both audience and participants while examining some frailties 
in the conduct of educational research. 

An eminent collection of AERA members has been assembled for 
the proposed symposium, representing specialties of educational 



research, evaluation, and development. While there wili clearly be 
variance in both the comedy and the candor of the participant's 
confessions, the general theme around which the symposium is 
organized deals with the identification of methodological deficiencies in 
the conduct of educational evaluation, research, and development. An 
examination of the particular presentations will reveal more clearly the 
nature of the symposium's substance. 

Robert E. Stake of the University of Illinois will speak on the topic 
of 'The Seven Principal Cardinals of Educational Evaluation." His 
presentation consists of a review of the principal principles to guide 
evaluation efforts, in cardinal order, as ordered by the CIRCE flock 
(the Center for Instructional Research and Curriculum Evaluation). 
These principles lead to an honoring of personal judgment, the 
protection of diversity in gathering and reporting perceptions, a 
moratorium on claims that the Red Sea was not held back, and other 
demands that persons be rational, plus an honoring of the belief that 
education is a part of the Good Life and needs no Life-Thereafter 
Payoff Justification. These principles are derived from the works of Yin 
and Yang. 

Addressing a major research dilemma faced within the nation, Lee S. 
Shulman of Michigan State University will make the following 
presentation: "Strategies for the Decentralization of Research Expertise 
in the United States." Professor Shulman, based as he is in a moderately 
sized middle western culture center, has through the years been faced 
with the near perfect isolation associated with a Big Ten University 
town. He will analyze the causative factors contributing to the current 
inequitable conditions, for it is his contention that clusters of 
educational research competence are not proportionately arranged 
within the U.S. Dr. Shulman will offer potential solutions to this 
crisis-laden problem arena, the solutions ranging in sophistication from 
almost to possibly. 

Richard E. Schutz of the Southwest Regional Laboratory for 
Educational Research and Development will offer the following 
presentation: "A Modest Proposal to Solve the Outstanding Problems 
of DOD and NASA with Educational Research Techniques." The 
proposal is directed to a problem solution. The severe problems of the 
United States in providing adequate defense of our nation and 
aggressive exploration of our universe are well known. Educational 
research has much to offer these endeavors. The most promising 
techniques of time-worn value in educational research will be extended 
to indicate the anticipated consequence^ were they to be adopted 
generally by the military and space complex. The mind-boggling 
simplicity of the extrapolation will be embellished at length and 
supported by rigorous rhetoric. Vivid verbiage will preclude any 
requirement for audio-visual support of the presentation. 

Calling upon his years of professional experience in the Bell 
Laboratories as an experimental psychologist and telephone repairman, 
Ernst Z. Rothkopf will speak on the multipurpose topic: "On the 
Epidemiology of Ignorance in Research Populations." Dr. Rothkopf has 
employed this title successfully with a wide variety of disparate topics 
and promises to extend that range in the present symposium. Should 
time permit. Dr. Rothkopf will lead the audience in audio-lingual 
pronunciation drills of the term "Mathemagenics." 

Focusing on the methodological problems associated with trial- 
revision educational development, W. James Popham of UCLA will 
offer the following presentation: 'The Seamy Side of Educational 
Development, Wherein the Author Reveals Unexpurgated and 
Previously Secret Episodes in the Lives of Stellar Developers." True life 
anecdotes in the instructional product development enterprise will be 
candidly recounted. Professor Popham may, or may not, formulatively 
evaluate audience reaction to his presentation by employing, with 
randomly selected attendees. Galvanic Skin Response devices and 
sponge-based perspiration indicators. 

Michael Scriven of the University of California, Berkeley will come 
to grips with a fundamental issue, 'The Pornographic Content of 
Evaluation Literature," and will incisively excise the latent eroticism 
thinly disguised in the writings of our foremost evaluation theorists. By 
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describing potential perversities on the part of certain evaluation 
writers. Professor Scriven's remarks will aid and abet those morally 
oriented decision makers who are wont to taxonomically classify 
literature along a chastity continuum. 

While the symposium will not call upon a formal discussant, 
participants have agreed to interact energetically with each other, e.g. 
through grimace and feigned approval, during presentations other than 
their own. 



MEASURING WITH THE SEMANTIC DIFFERENTIAL IN EDU- 
CATIONAL RESEARCH: SOME METHODOLOGICAL PROBLEMS 

MERVIN D. LYNCH, Northeastern University, ORGANIZER 

To date work with the semantic differential has been devoted 
mainly to the isolation of factors of connotative meaning and in these 
connections, the semantic differential has been extensively applied 
without sufficient knowledge of the methodological guidelines for its 
research use. The major objective of this symposium is to bring together 
research which has as its focus the study of methodological problems in 
the use of the semantic differential. From this research it should be 
possible to get a more specific idea of the range of application and 
availability of research strategies which will maximize information gain 
with the use of the semantic differential. 

E. Vaughn Gulo, College of Education, Northeastern University, 
reports on results of four studies whose major focus was to isolate and 
identify consistencies in student perceptions of teaching effectiveness 
of college professors. His paper is entitled "Measuring Dimensions of 
Teaching Effectiveness with the Semantic Differential." In these studies 
ratings were obtained from subject samples at two universities on 
semantic differential sca!es over an eight year period of time. These 
ratings were subjected to correlation and factor analysis. Results were 
threefold: Factors such as teaching dynamism, acceptance-change and 
action-freedom appear over time and with different student popula- 
tions; the proportion of variance for each of these factors varied 
between populations studied and from one factor analysis to another; 
the semantic differential seems to be an especially useful technique for 
quantifying emergent variables associated with students perceptions of 
teaching effectiveness and effective professors. 

Roger Brightbill, Department of Psychology, Northeastern Uni- 
versity, evaluates two experimental studies of group differences made 
with the semantic differential. His paper is entitled "Indexing Differ- 
ences Between Groups with the Semantic Differential." Such factors as 
the selection of concepts, the selection of scales and the selection of 
subjects are analyzed. Two studies including susceptible and non- 
susceptible hypnotic subjects are utilized as an example of this type of 
research. In the studies reported, concepts related to hypnosis, such as 
sleep, trance, science and magic were utilized along with scales felt to 
be appropriate to judging the concepts and representing three major 
factors identified by Osgood and his colleagues. No significant 
differences were found, leading to the conclusion that the semantic 
differential is not a good instrument for evaluating group differences. 

Richard Scotti and Mervin Lynch, College of Education, North- 
eastern University, report on the development and cross-validation of a 
set of semantic differential scales for measuring at elementary grade 
levels. This paper is entitled "Semantic Differential Scales for Indexing 
at Elementary Grade Levels." Ratings were obtained on 55 semantic 
differential scales on the concept myself from 216 elementary grade 
children distributed equally on 2nd, 4th, and 6th grade levels, males 
and females. Correlation and factor analyses were made on the 
responses for the 55 scales for each grade level and each sex. A least 
squares transform was computed between factor matrices, pairwise, for 
sex and grade levels. Semantic differential scales were selected which 
represented commonalities among intersections of the least squares 
transform, and these are presented in this paper. 

Irene Nichols, College of Education, Northeastern University, 
reports on the effects of ratings of concepts on scales with structural as 



opposed to common and familiar opposites. Her paper is entitled 
"Effects of type of Bi-polar Opposite Scales used on the Ratings of 
Concepts." Two groups of subjects, 18 in each group, rated twenty 
concepts on 16 semantic differential scales. The scales represented 
evaluative, potency, oriented activity and stability factors and were 
selected from scales reported by Osgood. Scales which were structural 
opposites such as kind-unkind and familiar or common opposites such 
as kind-cruel were alternated between the two groups and ratings 
obtained. The findings showed that no systematic overall effect in the 
ratings of concepts results from using structural as opposed to familiar 
and common opposites but limited scale specific effects did occur. 

In their haste to analyze semantic differential data, researchers more 
often than not have ignored the multidimensional nature of their 
measurement technique. They have obtained ratings on semantic 
differential scales representing various dimensions of meaning and have 
compared ratings on two or more concepts on individual scale or 
dimensional scores, but not on a single index of meaning. Mervin 
Lynch, College of Education, Northeastern University, evaluates the D 
statistic as a method of analysis of semantic differential data. His paper 
is entitled "Multidimensional Measurement with the D Statistic and the 
Semantic Differential." The D statistic (generalized distance function), 
such as used in studies by Tannenbaum and Lynch provides an index of 
the similarity between two profiles of judgment (such as ratings on a 
person and ratings on a standard) according to the following formula: 



D ’Vi-1 1X9 ~ X,k ' 2 

where (i) is a scale, (j) is a concept, (k) is a concept and (n) is the 
number of scales. This paper presents the D statistic, compares it to 
other avenues of analysis of semantic differential data, reports on prior 
applications and considers the distributional nature and interpretation 
of D in terms of direction and degree. 

The semantic differential has often been abused as a measurement 
technique, in that some researchers have utilized it to gather large 
arrays of data without prior planning on mode of analysis, selection of 
scales or applicability. Hopefully the presentations in this symposium 
will stimulate prior methodological evaluation in planning and use of 
the semantic differential and provide some useful guidelines to its 
research applicability. 

Tom Edwards of Boston University will discuss these papers. 



THEORIES OF CRITERION-REFERENCED TESTING 

SAMUEL A. LIVINGSTON, The Johns Hopkins University 

The purpose of the symposium will be to provide educators and 
educational researchers with techniques for assessing the statistical 
properties of criterion-referenced tests. Each of the three participants 
will propose a different set of techniques, each one based on a 
consistent theory of criterion-referenced testing. The three theories 
represent three fundamentally different approaches to criterion- 
referenced testing; they are based on classical test theory, on 
item-sampling theory, and on the use of repeated measures. Each of the 
three participants will answer some or all of the following six questions: 
1) what is a criterion-referenced (CR) test? 2) what assumptions form 
the basis for a theory of CR tests? 3) how can we determine the 
reliability of CR tests? 4) how can we validate CR tests? 5) how should 
we select items for CR tests? and 6) how can these procedures be 
justified intuitively? 

Samuel A. Livingston of Johns Hopkins University will present "A 
Classical Test-Theory Approach to Criterion-Referenced Tests." The ba- 
sis for this approach is the classical test-theory model: observed score 
equals true score plus error of measurement. The assumptions are those 
of classical test theory. Livingston defines a CR test as any test for 
which a criterion score has been specified as the score with which each 



